Point cloud encoding and decoding methods, encoders, decoders, and computer storage media

By adaptively changing the processing order of three-dimensional coordinate axes in the RAHT transformation process, the method enhances encoding and decoding efficiency for point cloud data.

KR103046189B1Active Publication Date: 2026-11-11GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
KR1020217043227
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-07-03
Filing Date
2020-05-15
Publication Date
2026-11-11
Estimated Expiration
2040-05-15

AI Technical Summary

Technical Problem

The existing methods for encoding and decoding point cloud data using Region Adaptive Hierarchal Transform (RAHT) suffer from low conversion efficiency due to the use of a fixed processing order, leading to reduced encoding and decoding efficiency.

Method used

Adaptive adjustment of the processing order for three-dimensional coordinate axes during the encoding and decoding process by determining and recording the coordinate axis order index number in the code stream, allowing for flexible RAHT transformation.

Benefits of technology

This approach fully utilizes the transformation efficiency of RAHT, significantly improving encoding and decoding efficiency by dynamically adjusting the processing order.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 112021152673618-PCT00051_ABST
    Figure 112021152673618-PCT00051_ABST
Patent Text Reader

Abstract

Embodiments of the present application disclose a point cloud encoding and decoding method, an encoder, a decoder, and a computer storage medium. In the point cloud encoding process, the encoder determines the processing order of three-dimensional coordinate axes for point cloud data, which is all or part of the data in the point cloud; determines a coordinate axis order index number corresponding to the processing order; performs encoding on the coordinate axis order index number and writes the encoding bits to a code stream; performs processing on the point cloud data according to the processing order to obtain the point cloud data to be encoded; performs encoding on the point cloud data to be encoded and writes the encoding bits to a code stream. The decoder parses the code stream to obtain the coordinate axis order index number; determines the processing order of three-dimensional coordinate axes for point cloud data, which is all or part of the data in the point cloud during the point cloud decoding process according to the coordinate axis order index number; parses the code stream to obtain the restored data of the point cloud data; and determines the location of the coordinate data of the point cloud data among the storage units of the restored data according to the processing order.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] This application is based on a prior U.S. provisional patent application with application number 62 / 870,553, filing date July 3, 2019, and titled "Method, Apparatus, and System for Encoding and Decoding Video Data," which claims priority of said prior U.S. provisional patent application and incorporates the entire contents of said prior U.S. provisional patent application into this application for reference.

[0002] The embodiments of the present application relate to the field of video encoding and decoding technology, and in particular to point cloud encoding and decoding methods, encoders, decoders, and computer storage media. Background Technology

[0003] In the Geometry-based Point Cloud Compression (G-PCC) encoder framework, the geometric information of the point cloud and the attribute information corresponding to each point cloud are encoded separately. After geometric encoding is complete, reconstruction is performed on the geometric information, and the encoding of the attribute information depends on the reconstructed geometric information.

[0004] Currently, attribute information encoding is primarily encoding of color information. First, color information is converted from the RGB color space to the YUV color space, then the point cloud is recolored using the reconstructed geometric information, and the unencoded attribute information is mapped to the reconstructed geometric information. There are mainly two transformation methods for color information encoding: one is a distance-based lifting transform that is distinguished by the Level of Detail (LOD), and the other is a Region Adaptive Hierarchal Transform (RAHT) that is performed directly. Both of these methods convert color information from the spatial domain to the frequency domain, obtain high-frequency and low-frequency coefficients through the transformation, and finally quantize and encode the coefficients to generate a binary code stream.

[0005] However, when performing RAHT conversion, if the same fixed order is used for any single point cloud, the conversion efficiency of RAHT cannot be fully utilized, and there is a problem with low conversion efficiency, which leads to reduced encoding and decoding efficiency. The problem to be solved

[0006] The embodiments of the present application provide a point cloud encoding and decoding method, an encoder, a decoder, and a computer storage medium that can adaptively change the order of coordinate processing during the encoding and decoding process and further fully utilize the conversion efficiency of RAHT, thereby solving the problem of low conversion efficiency and significantly improving encoding and decoding efficiency. means of solving the problem

[0007] The technical solution of the embodiments of the present application can be implemented as follows:

[0008] In a first aspect, an embodiment of the present application provides a point cloud encoding method applied to an encoder, said method, said method

[0009] A step of determining the processing order for point cloud data during the point cloud encoding process; wherein the processing order refers to the processing order of the coordinate axes of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud;

[0010] A step of determining a coordinate axis sequence index number corresponding to the above processing order;

[0011] A step of performing encoding on the above coordinate axis sequence index number and writing the encoding bits to the code stream;

[0012] A step of processing the point cloud data according to the above processing order to obtain point cloud data to be encoded;

[0013] It includes the step of encoding the point cloud data to be encoded and writing the encoding bits to a code stream.

[0014] In a second aspect, embodiments of the present application provide a point cloud decoding method applied to a decoder, said method, said method,

[0015] A step of parsing a code stream to obtain a coordinate axis order index number;

[0016] A step of determining the processing order for point cloud data during the point cloud decoding process according to the above coordinate axis order index number; wherein the processing order refers to the processing order of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud;

[0017] A step of parsing a code stream to obtain restored data of the point cloud data;

[0018] According to the above processing order, the method includes the step of determining the location of the coordinate data of the point cloud data in the storage unit of the restored data.

[0019] In a third aspect, an embodiment of the present application provides an encoder comprising a first determination portion, an encoding portion, and a conversion portion, and

[0020] The above-mentioned first determination part is configured to determine the processing order for point cloud data during the point cloud encoding process, wherein the processing order refers to the processing order of the coordinate axes of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud; and determines a coordinate axis order index number corresponding to the processing order;

[0021] The above encoding portion is configured to perform encoding on the above coordinate axis order index number and write the encoding bit to the code stream;

[0022] The above transformation part is configured to perform processing on the point cloud data according to the above processing order to obtain the point cloud data to be encoded;

[0023] The above encoding part is further configured to perform encoding on the point cloud data to be encoded and write the encoding bits to the code stream.

[0024] In a fourth aspect, an embodiment of the present application provides an encoder comprising a first processor and a first memory in which an executable instruction of the first processor is stored, and when the instruction is executed, the first processor implements the point cloud encoding method.

[0025] In a fifth aspect, an embodiment of the present application provides a decoder comprising a parsing portion, a second determination portion, and a second conversion portion, and

[0026] The above parsing part is configured to parse a code stream to obtain a coordinate axis order index number, and

[0027] The second determination part is configured to determine the processing order for point cloud data during the point cloud decoding process according to the coordinate axis order index number; whereby the processing order refers to the processing order of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud;

[0028] The above parsing portion is also further configured to parse a code stream to obtain restored data of the point cloud data;

[0029] The second determination part is also further configured to determine the location of the coordinate data of the point cloud data in the storage unit of the restoration data according to the processing order.

[0030] In a sixth aspect, an embodiment of the present application provides a decoder comprising a second processor and a second memory in which an executable instruction of the second processor is stored, and when the instruction is executed, the first processor implements the point cloud decoding method.

[0031] In a seventh aspect, an embodiment of the present application provides a computer storage medium, said computer storage medium has a computer program stored therein, said computer program implements the point cloud encoding method when executed by a first processor or implements the point cloud decoding method when executed by a second processor. Effects of the invention

[0032] Embodiments of the present application disclose a point cloud encoding and decoding method, an encoder, a decoder, and a computer storage medium. In the point cloud encoding process, the encoder determines the processing order of three-dimensional coordinate axes for point cloud data, which is all or part of the data in the point cloud; determines a coordinate axis order index number corresponding to the processing order; performs encoding on the coordinate axis order index number and writes the encoding bits to a code stream; performs processing on the point cloud data according to the processing order to obtain the point cloud data to be encoded; and performs encoding on the point cloud data to be encoded and writes the encoding bits to a code stream. The decoder parses the code stream to obtain the coordinate axis order index number; determines the processing order of three-dimensional coordinate axes for point cloud data, which is all or part of the data in the point cloud, in the point cloud decoding process according to the coordinate axis order index number; parses the code stream to obtain the restored data of the point cloud data; and determines the location of the coordinate data of the point cloud data among the storage units of the restored data according to the processing order. In other words, in an embodiment of the present application, at the encoding side, the encoder first determines the processing order of the transformation processing corresponding to the point cloud data and performs RAHT transformation according to the processing order, and at the same time records the processing order in a code stream and transmits it to the decoder, and at the decoding side, the decoder obtains the processing order of the transformation processing corresponding to the point cloud data through parsing the code stream and performs RAHT transformation according to the processing order.Accordingly, the point cloud encoding and decoding method proposed in this application no longer uses a fixed RAHT transformation order for all or part of the data in the point cloud, and by describing the processing order using grammatical elements in the code stream, the coordinate processing order during the encoding and decoding process can be adaptively changed, and furthermore, the transformation efficiency of RAHT can be fully utilized, thereby solving the problem of low transformation efficiency and significantly improving encoding and decoding efficiency. Brief explanation of the drawing

[0033] Figure 1 is a G-PCC encoding block flowchart. Figure 2 is a G-PCC decoding block flowchart. Figure 3 is a spatial encoding schematic diagram 1. Figure 4 is a spatial encoding schematic diagram 2. Figure 5 is a spatial encoding schematic diagram 3. Figure 6 is a spatial encoding schematic diagram 4. Figure 7 is a schematic diagram of the RAHT transformation 1. Figure 8 is a schematic diagram of the RAHT transformation 2. Figure 9 is a schematic diagram of RAHT transformation 3. Figure 10 is an implementation flowchart 1 of point cloud encoding. Figure 11 is an implementation flowchart 2 of point cloud encoding. Figure 12 is an implementation flowchart 1 of point cloud decoding. Figure 13 is an implementation flowchart 2 of point cloud decoding. Figure 14 is a diagram explaining the configuration structure of the encoder. Figure 15 is a diagram explaining the configuration structure of the encoder. Figure 16 is a diagram explaining the configuration structure of the decoder. Figure 17 is a diagram explaining the configuration structure of the decoder. Specific details for implementing the invention

[0034] In order to enable a more detailed understanding of the features and technical content of the embodiments of the present application, the implementation of the embodiments of the present application is described in detail below in conjunction with the attached drawings; however, the attached drawings are provided for reference only and are not intended to limit the embodiments of the present application.

[0035] In an embodiment of the present application, among the point cloud G-PCC encoder frameworks, a three-dimensional image model inputs a point cloud, divides it into slices, and performs independent encoding for each slice.

[0036] Figure 1 is a block flowchart of G-PCC encoding. The G-PCC encoding block flowchart shown in Figure 1 is applied to a point cloud encoder. For the point cloud data to be encoded, the point cloud data is first divided into multiple slices through slice partitioning. Among each slice, the geometric information of the point cloud and the attribute information corresponding to each point cloud are separated to perform encoding. During the geometric encoding process, coordinate transformation is performed on the geometric information so that the entire point cloud is contained within a single bounding box, and then quantization is performed. This quantization step primarily serves the role of scaling (compression / expansion). Due to quantization rounding, the geometric information of some point clouds becomes identical; therefore, a decision is made whether to remove duplicate points based on parameters. The quantization and duplicate point removal processes are also referred to as voxelization. Subsequently, octree partitioning is performed on the bounding box. In an octree-based geometric information encoding process, the bounding box is divided into eight subcubes, and the non-empty subcubes (including points in the point cloud) are continuously divided into eight. When a unit cube with 1 × 1 × 1 leaf nodes is reached, the division is stopped, and arithmetic coding is performed on the points among the leaf nodes to generate a binary geometric bit stream, i.e., a geometric code stream.Similarly, in the geometric information encoding process based on triangle soup (trisoup), octree partitioning must be performed first; however, the difference from octree-based geometric information encoding is that the trisoup does not require stepwise partitioning of the point cloud until it becomes a unit cube with a side length of 1 × 1 × 1. Instead, partitioning is stopped when the side length of a block (sub-block) reaches W. Based on the surface formed by the distribution of the point cloud within each block, up to 12 vertices are obtained from the surface and the 12 sides of the block. Arithmetic encoding is then performed on the vertices (by performing surface fitting based on the vertices) to generate a binary geometric bit stream, i.e., a geometric code stream. The vertices are also used in the implementation of the geometric reconstruction process, and the reconstructed set information is used for attribute encoding of the point cloud.

[0037] In the attribute encoding process, once geometric encoding is complete, reconstruction is performed on the geometric information, followed by color conversion to transform the color information (i.e., attribute information) from the RGB color space to the YUV color space. Subsequently, the point cloud is recolored using the reconstructed geometric information, and the unencoded attribute information is mapped to the reconstructed geometric information. Attribute encoding is primarily performed on color information, and there are mainly two transformation methods in the color information encoding process. One is a distance-based lifting transform distinguished by the Level of Detail (LOD), and the other is a Region Adaptive Hierarchal Transform (RAHT) performed directly. Both of these methods convert color information from the spatial domain to the frequency domain, obtain high-frequency and low-frequency coefficients through the transformation, and finally quantize the coefficients (i.e., quantization coefficients). Finally, the geometric encoding data and the attribute encoding data processed by octree partitioning and surface fitting are combined into slices, and the vertex coordinates of each block are sequentially encoded (i.e., arithmetic encoding) to generate a binary attribute bit stream, i.e., an attribute code stream.

[0038] FIG. 2 is a G-PCC decoding block flowchart, which is applied to a point cloud decoder as shown in FIG. 2. For the acquired binary code stream, decoding is first performed independently on the geometric bit stream and the attribute bit stream within the binary code stream. When decoding the geometric bit stream, geometric information of the point cloud is obtained through arithmetic decoding, octree synthesis, surface fitting, geometric reconstruction, and inverse coordinate transformation; when decoding the attribute bit stream, attribute information of the point cloud is obtained through arithmetic decoding, antiquantization, LOD-based lifting inverse transform or RAHT-based inverse transform, and inverse chromatic transformation, a three-dimensional image model of the point cloud data to be encoded is reduced based on the geometric information and the attribute information.

[0039] In the block flowchart of the G-PCC encoding shown in Fig. 1, the RAHT transform is the part that performs encoding on the attribute information of the point cloud; it performs lossy encoding through the principle of the Harr wavelet transform and is generally applied to sparse point clouds. Specifically, since the geometric coordinate information of the point cloud has already been obtained prior to the RAHT transform, the Morton Code corresponding to each point in the point cloud can be obtained using the point coordinate information. Because the encoding order of the Morton Code follows the spatial z-order, it is also referred to as a z-order code. Specifically, the method for calculating the Morton Code is as follows, and each component d For three-dimensional coordinates represented by bit binary, the representation of the three coordinate components is implemented through the following formula:

[0040]

[0041] Here, are each The best beat of ( Lowest bit in ) It is the binary value corresponding to ). Morton code silver Regarding, starting from the highest bit to the lowest bit, sequentially It is arranged in an alternating pattern, The calculation formula is as follows:

[0042]

[0043] Here, Each The best beat of ( Lowest bit in ) It is the value up to ). Morton code of each point in the point cloud After obtaining it, arrange the points in the point cloud in order from smallest to largest Morton codes, and the weight of each point Set to 1. In computer language, this is similar to the combination z|(y << 1)|(x << 2).

[0044] Figure 3 is a schematic diagram of spatial encoding 1 and Figure 4 is a schematic diagram of spatial encoding 2. Figures 3 and 4 are combined for explanation, and according to the order of high and low bit arrays, z, y, and x (x|(y << 1)|(z << 2)) are used as examples for explanation.

[0045] Figure 3 shows the spatial encoding of each pixel of an 8*8 image, in which position coordinates of x and y values ​​between 0 and 7 are encoded as one-dimensional binary numbers from 000000 to 111111. By interleaving the binary coordinate values ​​to obtain a map of binary z values ​​and connecting them in a z-shape along the numerical direction, a recursive z-shaped curve is generated. Z values ​​are placed according to the connection order at each position in the drawing. In fact, the drawing above is generated repeatedly along the Z direction, increasing recursively by two digits each time from 00-11 (one z in the entire drawing) to 0000-1111 (one z placed at each point of the previous z), and then to 000000-111111 (one z placed at each point of the previous z).

[0046] For example, FIG. 4 shows spatial encoding sequences of 2 x 2, 4 x 4, 8 x 8, and 16 x 16, through which it can be seen that the encoding sequence of Morton code is implemented according to the spatial z-order.

[0047] FIG. 5 is a spatial encoding schematic diagram 3 and FIG. 6 is a spatial encoding schematic diagram 4, which is a case of lifting in three dimensions. The recursive process implements coordinate interleaving as illustrated in FIG. 5 and FIG. 6, thereby continuously dispersing coordinate values ​​overall. x|(y << 1)|(z << 2) means that each coordinate value is dispersed, and each bit is interleaved sequentially in the order where z comes first, y comes last, and x comes last. The decoding process is precisely the aggregation process.

[0048] The RAHT transformation is performed based on the hierarchical structure obtained by performing octree partitioning on point cloud data, and the transformation is performed layer by layer starting from the bottom layer of the octree. Fig. 7 is an explanatory diagram of the RAHT transformation 1. As shown in Fig. 7, after the octree partitioning is completed, a voxel block 1 (i.e., a geometric body in Fig. 7 in which three types of color depths appear alternately, where each block represents a point in the point cloud) is obtained. The RAHT transformation is performed starting from the bottom layer; taking the transformation order as XYZ as an example, the RAHT transformation is first performed along the X direction as shown in Fig. 7. If there are adjacent voxel blocks in the X direction, RAHT is performed on both to obtain the weighted average value (DC coefficient) and residual error (AC coefficient) of the attribute values ​​of the two adjacent points. Here, the obtained DC coefficient exists as attribute information of the parent node voxel block 2, and the RAHT transformation of the next layer is performed; The AC coefficients are reserved for the final encoding. If there are no adjacent points, the attribute values ​​of the voxel block are directly passed to the parent node of the second layer. When performing the RAHT transformation in the second layer, it is performed along the Y direction; if there are adjacent voxel blocks in the Y direction, RAHT is performed on both to obtain the weighted average (DC coefficient) and residual (AC coefficient) of the attribute values ​​of the two adjacent points. Subsequently, the RAHT transformation in the third layer is performed along the Z direction to obtain parent node voxel block 3, which alternates between three color depths, and is used as a child node of the next layer in the octree. Then, the RAHT transformation is performed again along the x, y, and Z directions, cyclically until only one parent node exists in the entire point cloud.

[0049] In fact, when traversing points in a point cloud, the process is performed using the Morton code of the sorted point cloud, that is, by determining whether the value after shifting the Morton code one bit to the right is the same, it is determined whether two child nodes are under one parent node.

[0050] Attribute values ​​of two adjacent points The specific RAHT transformation process for is as follows:

[0051]

[0052] Here,

[0053]

[0054] and, luma is obtained from the arrangement of the input quantization parameters, and is a weight corresponding to the DC coefficient, obtained through calculation. The DC coefficient is the weighted average of the attributes, and the AC coefficient is the attribute residual of two adjacent points. In the first layer, the attribute value is used as the DC coefficient value obtained by calculation in another layer. It corresponds to.

[0055] In the embodiments of the present application, the specific steps of the RAHT transformation are as follows:

[0056] (1) A step in which the attribute values ​​of points in the point cloud are used as the DC coefficients of the first layer, and all of their weights are set to 1, and RAHT transformation is started.

[0057] (2) A step to write the DC coefficients and AC coefficients of this layer to the next layer, the parent layer and parent node, according to the corresponding index; if there are no AC coefficients, do not write them.

[0058] (3) A step of traversing the DC coefficient corresponding to the index according to the index after sorting in Morton code order.

[0059] (4) A step of shifting the Morton code corresponding to each DC coefficient 1 bit to the right, wherein the Morton code of each DC coefficient represents the Morton code of its parent node.

[0060] (5) Figure 8 is a RAHT transformation diagram 2. As shown in Figure 8, determine whether the Morton codes of two DC coefficients are the same. If they are the same, it indicates that they are under the same parent node. Then, perform RAHT on both of them. Write the obtained DC coefficient to the DC coefficient section of the parent node of the next layer, write the AC coefficient to the last DC coefficient section of the next layer, and assign the weight of the sum of the two DC coefficients to the DC coefficient of the parent node; if they are different, write the DC coefficient and its weight directly to the next layer.

[0061] (6) A step of repeating (2)-(5) until there is only one DC coefficient in one layer.

[0062] (7) Finally, a step of performing quantization on the DC coefficients and encoding on the attribute values ​​of the DC coefficients and AC coefficients of this layer.

[0063] Correspondingly, among the decoder blocks, the RAHT transformation sequence also needs to be used for the inverse RAHT transformation.

[0064] The decoding process of RAHT is introduced below.

[0065] The RAHT decoding process is the inverse transformation of the RAHT encoding process and is identical to the encoding process. Before the inverse transformation, the Morton code of each point in the point cloud is calculated to obtain the Morton code M of each point, then the points in the point cloud are arranged in ascending order and the weight of all points is set to 1. The RAHT inverse transformation process traverses all points in the point cloud according to the order after sorting the Morton codes.

[0066] Since the RAHT transformation is performed layer by layer, it starts from the lower layer, performs determination of neighboring points in the point cloud layer by layer, and performs the RAHT transformation on the attribute values ​​according to the weights, whereas the inverse RAHT transformation process starts from the upper layer and performs the inverse RAHT transformation from top to bottom, so the weight information of each layer must be obtained before the inverse RAHT transformation.

[0067] Before performing the inverse RAHT transformation, using the acquired Morton code information, starting from the lower layer, a single decision is made for the neighboring nodes of each layer's RAHT at the encoding end to obtain the corresponding positions of the weight information and AC coefficients of each layer, and the corresponding Morton code is shifted left by 1 bit each time RAHT is performed for each layer. To facilitate subsequent use, the weight information and the Morton code information corresponding to the nodes in each layer are recorded in a buffer.

[0068] When performing the inverse RAHT transformation, starting from the upper layer, the determination of neighboring nodes is performed according to the Morton code information of each layer, and the inverse RAHT transformation is performed using the acquired weight information and the attribute information obtained through decoding. FIG. 9 is a schematic diagram of the RAHT transformation, and as shown in FIG. 9, the inverse RAHT transformation corresponds to the process from the k+1th layer to the kth layer. When determining neighboring nodes, the inverse RAHT transformation is performed by taking the traversed DC coefficient and the corresponding AC coefficient.

[0069] More specifically, the attribute values ​​of two adjacent points The specific inverse RAHT transform process for is as follows:

[0070]

[0071] Specifically, when performing RAHT on point cloud attribute information in a hierarchical manner, RAHT is repeatedly performed on each node along three axes placed in a fixed order within each layer. However, if RAHT is performed on any single point cloud using the same fixed order, the transformation efficiency of RAHT cannot be fully realized. For example, in current G-PCC, the fixed order generally used is ZYX, but other possible transformation orders exist, such as XYZ. When RAHT transformation is performed on nodes in a point cloud using the ZYX order, there is a problem of low transformation efficiency, which leads to reduced encoding and decoding efficiency.

[0072] To overcome the above defects, embodiments of the present application propose a point cloud encoding and decoding method, an encoder, a decoder, and a computer storage medium. On the encoding side, the encoder first determines the processing order of a transformation process corresponding to the point cloud data, performs RAHT transformation according to the processing order, and simultaneously records the processing order in a code stream and transmits it to the decoder. On the decoding side, the decoder determines the processing order of a transformation process corresponding to the point cloud data obtained through the analysis of the code stream, and performs RAHT transformation according to the processing order. Accordingly, the point cloud encoding and decoding method proposed by the present application no longer uses a fixed RAHT transformation order for all or part of the data of the point cloud, but rather describes the processing order using syntax elements in the code stream. By doing so, the coordinate processing order during the encoding and decoding process can be adaptively changed, thereby fully utilizing the RAHT transformation efficiency and solving the problem of low transformation efficiency, which significantly improves the encoding and decoding efficiency.

[0073] In this application, it will be understood that the point cloud encoding method of the embodiment of this application can be applied to the RAHT transformation part shown in FIG. 1, and correspondingly, the point cloud decoding method of the embodiment of this application can also be applied to the RAHT transformation part shown in FIG. 2. In other words, the point cloud encoding and decoding methods among the embodiments of this application can be applied not only to a video encoding system but also to a video decoding system, and even simultaneously to a video encoding system and a video decoding system, provided that the embodiments of this application are not specifically limited.

[0074] The technical solution in the embodiment of the present application will be clearly and completely explained below by combining it with the attached drawings.

[0075] One embodiment of the present application provides a point cloud encoding method. FIG. 10 is an implementation flowchart 1 of point cloud encoding, and as illustrated in FIG. 10, in an embodiment of the present application, a method for an encoder to perform encoding on a point cloud may include the following steps:

[0076] Step 101: A step of determining the processing order for point cloud data during the point cloud encoding process; where the processing order refers to the processing order of the coordinate axes of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or some data in the point cloud.

[0077] In an embodiment of the present application, the encoder may first determine the processing order for the point cloud data during the point cloud encoding process. Here, the point cloud data is all or part of the data in the point cloud, and the processing order may be intended to indicate the processing order of the coordinate axes of the three-dimensional coordinates of the point cloud data.

[0078] In the embodiments of the present application, the point cloud data may be all data within the point cloud, and accordingly, it will be understood that determining the processing order of the point cloud data is precisely determining the processing order of all data within the point cloud. In other words, in the present application, for each point in the point cloud, the encoder can perform conversion processing in the same processing order.

[0079] Furthermore, in an embodiment of the present application, the encoder may perform segmentation on the point cloud to obtain a plurality of slices corresponding to the point cloud, and thus, the point cloud data may be part of the data in the point cloud. That is, the point cloud data may be any one of the slice data in the point cloud, and correspondingly, determining the processing order of the point cloud data is determining the processing order of any one of the slice data in the point cloud. In other words, in the present application, for each point of the same slice in the point cloud, the encoder may perform transformation processing in the same processing order.

[0080] In the embodiments of the present application, the processing order is the transformation order used during RAHT transformation, and each point in the point cloud is X, Y, and Z three-dimensional point cloud data; therefore, it can be understood that the processing order indicates the order of performing transformations sequentially on the X, Y, and Z coordinate axes.

[0081] For example, in an embodiment of the present application, when performing RAHT on point cloud attribute information in a hierarchical manner, RAHT is performed repeatedly for each node along three axes based on the processing order within each layer. For example, if the processing order is XYZ order, the encoder may perform RAHT on nodes in the point cloud in the order of X first, then Y, and finally Z; and if the processing order is YZX, the encoder may perform RAHT on nodes in the point cloud in the order of Y first, then Z, and finally X.

[0082] In the embodiments of the present application, since each point in the point cloud is X, Y, and Z three-dimensional point cloud data, it can be understood that the order in which the encoder performs RAHT transformation may include six different combinations. That is, the processing order may be six different transformation orders.

[0083] In addition, in an embodiment of the present application, the data processing order of the point cloud may be any one of the ZYX order, XYZ order, XZY order, YZX order, ZXY order, and YXZ order; where X, Y, and Z are the coordinate axes of the three-dimensional coordinates of the point cloud data.

[0084] As should be noted, in an embodiment of the present application, when the encoder determines the processing order for point cloud data during the point cloud encoding process, the processing order can be determined according to the main code of the nodes among the point cloud data.

[0085] Specifically, in an embodiment of the present application, the encoder first calculates the Morton code of each node in the point cloud data, then sorts the nodes in the point cloud data in ascending order according to the Morton code, and finally traverses each node in the point cloud data according to the sorted order.

[0086] Step 102: A step for determining the coordinate axis order index number corresponding to the processing order.

[0087] In an embodiment of the present application, the encoder may determine the processing order for point cloud data during the point cloud encoding process, and then further determine a coordinate axis order indexer number corresponding to the processing order.

[0088] It will be understood that for each different processing order, the encoder can set different coordinate axis order index numbers. Correspondingly, since the processing order can be any one of six different transformation orders, the coordinate axis order index numbers can also include six different values.

[0089] In addition, in an embodiment of the present application, when the encoder determines a coordinate axis sequence index number corresponding to the processing order, the value of the coordinate axis sequence index number corresponding to the processing order can be set according to a correspondence table between a preset index number and the processing order.

[0090] Specifically, in the present application, Table 1 is a correspondence table between a preset index number and a processing order, and as shown in Table 1, for each different processing order, the corresponding coordinate axis order index number can be determined by looking up the correspondence table between the preset index number and the processing order.

[0091]

[0092] As can be seen from Table 1 above, in the present application, the processing order and the coordinate axis order index number do not correspond to each other. For the six types of RAHT transformation orders, two different coordinate axis order index numbers correspond to the ZYX order, specifically, the ZYX order corresponds to index number 0 and index number 4, respectively; and two different coordinate axis order index numbers correspond to the XYZ order, specifically, the XYZ order corresponds to index number 1 and index number 7, respectively. In addition, the remaining four types of RAHT transformation orders other than the ZYX order and the XYZ order correspond to a single unique coordinate axis order index number. Here, the XZY order corresponds to index number 2, the YZX order corresponds to index number 3, the ZXY order corresponds to index number 5, and the YXZ order corresponds to index number 6.

[0093] For example, in the present application, when the encoder sets the value of the coordinate axis order index number corresponding to the processing order according to a correspondence table between a preset index number and the processing order, if the processing order of the point cloud data is ZYX order, the encoder may set the value of the coordinate axis order index number to 0 or 4; if the processing order of the point cloud data is XYZ order, the encoder may set the value of the coordinate axis order index number to 1 or 7; if the processing order of the point cloud data is XZY order, the encoder may set the value of the coordinate axis order index number to 2; if the processing order of the point cloud data is YZX order, the encoder may set the value of the coordinate axis order index number to 3; if the processing order of the point cloud data is ZXY order, the encoder may set the value of the coordinate axis order index number to 5; and if the processing order of the point cloud data is YXZ order, the encoder may set the value of the coordinate axis order index number to 6.

[0094] It should be noted that in this application, G-PCC does not have the concept of specific X, Y, and Z coordinate axes, and in general, the coordinate axis processing order can be indicated as 0, 1, and 2 based on the X, Y, and Z coordinate axes. For example, if the processing order is in the order of XYZ, it can be represented as 0-1-2.

[0095] Based on Table 1 above, Table 2 is a correspondence table between a preset index number and a processing order, and as shown in Table 2, for each different processing order, the corresponding coordinate axis order index number can be determined by looking up the correspondence table between the preset index number and the processing order.

[0096]

[0097] For example, in the present application, when the encoder sets the value of the coordinate axis order index number corresponding to the processing order according to a correspondence table between a preset index number and the processing order, if the processing order of the point cloud data is in ZYX order, i.e., 2-1-0, the encoder may set the value of the coordinate axis order index number to 0 or 4; if the processing order of the point cloud data is in XYZ order, i.e., 0-1-2, the encoder may set the value of the coordinate axis order index number to 1 or 7; if the processing order of the point cloud data is in XZY order, i.e., 0-2-1, the encoder may set the value of the coordinate axis order index number to 2; and if the processing order of the point cloud data is in YZX order, i.e., 2-0-1, the encoder may set the value of the coordinate axis order index number to 3. If the processing order of the point cloud data is ZXY order, i.e., 1-2-0, the encoder can set the value of the coordinate axis order index number to 5; and if the processing order of the point cloud data is YXZ order, i.e., 1-0-2, the encoder can set the value of the coordinate axis order index number to 6.

[0098] In this application, it will be understood that the coordinate axis order index number can be indicated through the syntax axis_coding_order, that is, the processing order of the three coordinate axes X, Y, and Z can be specified through the syntax axis_coding_order. Specifically, based on Table 2 above, the axis_coding_order for the G-PCC standard can be used to process data within the buffer area of ​​RecPic[pointIdx][axis]. For example, when the value of axis_coding_order is equal to 0, i.e., when the processing order is ZYX, if the axis value is equal to 0, i.e., what is stored in RecPic[pointIdx][0] is the Z-axis data; if the axis value is equal to 1, i.e., what is stored in RecPic[pointIdx][1] is the Y-axis data; and if the axis value is equal to 2, i.e., what is stored in RecPic[pointIdx][2] is the X-axis data.

[0099] Step 103: A step of performing encoding on the coordinate axis order index number and writing the encoded bit to the code stream.

[0100] In an embodiment of the present application, the encoder can determine a coordinate axis sequence index number corresponding to the processing order, perform further encoding on the coordinate axis sequence index number, and then write the encoding bits to the code stream.

[0101] In addition, in an embodiment of the present application, the encoder performs encoding for a coordinate axis order index number and, when writing the encoding bit to a code stream, first performs encoding for the coordinate axis order index number using an equal length coding method, determines the encoding bit, and then writes the encoding bit to the code stream.

[0102] In the present application, it will be understood that equal-length encoding means encoding any one value (probabilities may differ) of an information source output code sequence into output code words of equal length without using the statistical characteristics of the information source. Here, the encoder uses the equal-length encoding method to encode the coordinate axis order index number and then obtains an equal-length code of equal length.

[0103] Additionally, in an embodiment of the present application, the encoder performs encoding for a coordinate axis sequence index number and, when writing the encoding bit to a code stream, may write the encoding bit to a code stream corresponding to a data unit of a parameter set; wherein the data unit of the parameter set includes a parameter used to decode point cloud data.

[0104] It should be noted that in the embodiments of the present application, the parameter set may be a parameter set of a sequence layer.

[0105] Additionally, in an embodiment of the present application, the parameter set may be a sequence parameter set.

[0106] It should be noted that in an embodiment of the present application, attribute information of point cloud data may be included in the data unit of the parameter set; whereby the attribute information is a scalar or vector attribute related to a point among the point cloud data.

[0107] In an embodiment of the present application, the data unit of the parameter set may further include geometric information of the point cloud data; whereby it will be understood that the geometric information is Cartesian coordinates associated with a point in the point cloud data.

[0108] In addition, in an embodiment of the present application, when an encoder performs encoding on a coordinate axis sequence index number and records the encoding bits in a code stream, the encoding bits can be recorded in a data unit where auxiliary information of the code stream is located.

[0109] For example, in an embodiment of the present application, the auxiliary information may be video usability information (VUI).

[0110] Video availability information provides additional information to the corresponding bitstream to enable the user to perform a wider range of applications. For example, among the bitstream limit information, the video availability information specifies (1) whether motion crosses the boundaries of the picture; (2) the maximum number of bytes per picture; (3) the maximum number of bits per macroblock; (4) the maximum motion vector length (horizontal and vertical); (5) the number of rearranged frames; and (6) the size of the maximum decoding frame buffer. When the decoder sees the above information, the decoder can customize the decoding operation based on stricter limits rather than using "level" information to set the decoding demand (typically higher than the actual demand of the bitstream).

[0111] For example, in an embodiment of the present application, the auxiliary information may be supplemental enhancement information, wherein SEI is a concept within the code stream category, provides a method for adding information to a video code stream, and is one of the H.264 / H.265 video compression standard characteristics.

[0112] SEI is not a mandatory element of the decoding process, but it may aid in the decoding process (fault tolerance, error correction) and can be integrated into the video code stream. In other words, when the encoder outputs the video code stream, it may not provide SEI information, or it may discard SEI due to some cause during the video transmission, decapsulation, and decoding stages.

[0113] In an embodiment of the present application, it will be understood that when an encoder performs encoding on a coordinate axis order index number and writes the encoding bits to a code stream, the encoding bits may be written to a transmission stream containing point cloud encoded data corresponding to the point cloud data. In other words, the code stream may be a transmission stream containing point cloud encoded data.

[0114] Additionally, in an embodiment of the present application, the encoder performs encoding for a coordinate axis sequence index number, and when writing the encoding bits to a code stream, the encoding bits can be written to a media file containing point cloud encoding data corresponding to the point cloud data. In other words, the code stream may be a media file containing point cloud encoding data.

[0115] In other words, in the present application, the coordinate axis order index number axis_coding_order can perform encoding among the auxiliary information of the SPS (e.g., VUI), can perform encoding in other auxiliary information data units of the point cloud data (e.g., SEI), and can be further extended to perform encoding in auxiliary information units of a transmission stream or file format.

[0116] Step 104: A step of obtaining point cloud data to be encoded by performing processing on the point cloud data according to the processing order.

[0117] In an embodiment of the present application, the encoder can obtain point cloud data to be encoded by determining the processing order for point cloud data during the point cloud encoding process, that is, after step 101, subsequently processing the point cloud data according to the processing order.

[0118] In the embodiments of the present application, it can be understood that the processing order is the conversion order when performing RAHT conversion on point cloud attribute information, and thus, after the encoder determines the processing order, the corresponding point cloud data to be encoded can be obtained by performing RAHT conversion using the point cloud data corresponding to the processing order.

[0119] As should be noted, in the embodiment of the present application, since the point cloud data may be all data in the point cloud, the processing order may be the conversion order of all data in the point cloud, and thus, after the encoder determines the processing order, it can sequentially perform RAHT conversion on each point in the point cloud through the processing order.

[0120] In addition, in an embodiment of the present application, since the point cloud data may be part data of the point cloud, that is, the point cloud data may be slide data of any one of the point clouds, the processing order may be the conversion order of the part data of the point cloud, and thus the decoder may determine the processing order corresponding to any slice of the point cloud and then sequentially perform RAHT conversion on each point in the slice through the processing order.

[0121] In other words, in the present application, if the processing order is the transformation order of all data in the point cloud, the encoder performs RAHT transformation using the same transformation order for all data in the point cloud; if the processing order is the transformation order of some data in the point cloud, the encoder may perform RAHT transformation using the same transformation order for some data in the point cloud, and may perform RAHT transformation using the same transformation order for data in one slice of the number of divisions.

[0122] In addition, in an embodiment of the present application, the encoder performs processing on point cloud data according to the processing order, and when acquiring point cloud data to be encoded, first performs coordinate mapping processing on the point cloud data according to the processing order.

[0123] Specifically, in an embodiment of the present application, when the encoder performs coordinate mapping processing on point cloud data according to the processing order, it can perform rearrangement on the coordinates of the point cloud data according to the processing order.

[0124] In addition, in an embodiment of the present application, when the encoder obtains point cloud data to be encoded by performing processing on point cloud data according to the processing order, processing can be performed on the point cloud data sequentially in the direction of the corresponding coordinate axis according to the processing order.

[0125] It should be noted that in this application, the process of performing the RAHT transformation is a method of sequentially first performing the transformation in one coordinate direction, then performing the transformation in another coordinate direction, and finally performing the transformation in a third coordinate direction.

[0126] In the embodiments of the present application, when the encoder performs processing on point cloud data in the corresponding coordinate axis directions sequentially according to the processing order, it will be understood that RAHT processing can be performed on point cloud data in the corresponding coordinate axis directions sequentially according to the processing order.

[0127] In addition, in an embodiment of the present application, when the encoder performs RAHT processing on point cloud data sequentially in the direction of the corresponding coordinate axes according to the processing order, it may first determine the Morton code of the node among the point cloud data, and then perform RAHT transformation on the point cloud data according to the processing order and the Morton code.

[0128] In addition, in an embodiment of the present application, when the encoder performs RAHT transformation on point cloud data according to the processing order and Morton code, it can first determine whether the processing order is the same as the preset order.

[0129] In the embodiments of the present application, it will be understood that the preset order may be a default conversion order stored in advance by the encoder. For example, the encoder may set the preset order in the order of ZYX.

[0130] In addition, in an embodiment of the present application, the encoder may perform a comparison between the processing order and the preset order, and if the processing order is the same as the preset order, the encoder may directly perform RAHT transformation on the point cloud data according to the preset order and Morton code; and if the processing order is different from the preset order, the encoder may perform RAHT transformation on the point cloud data according to the processing order and Morton code.

[0131] As should be noted, in an embodiment of the present application, FIG. 11 is an implementation flowchart 2 of point cloud encoding, and as illustrated in FIG. 11, after the encoder determines the processing order for the point cloud data during the point cloud encoding process, i.e., after step 101, and before determining the coordinate axis order index number corresponding to the processing order, i.e., before step 102, the method of the encoder performing encoding on the point cloud data may further include the following steps:

[0132] Step 106: A step of determining the sequence indicator parameter according to the processing order; where the sequence indicator parameter is to indicate whether to use a preset order.

[0133] Step 107: A step of performing encoding on the sequence indicator parameter and writing the encoded bit to the code stream.

[0134] After determining the processing order for the point cloud data, the encoder can first set the order indicator parameters according to the processing order, then perform encoding on the order indicator parameters, and write the encoded bitstream to the code stream.

[0135] It should be noted that, in the embodiment of the present application, the sequence indicator parameter may be intended to indicate whether a preset sequence is used. In other words, if the encoder performs conversion processing using a preset sequence, that is, the sequence indicator parameter may be set to indicate that the preset sequence is used. If the encoder does not perform conversion processing using a preset sequence, that is, the sequence indicator parameter is set to indicate that the preset sequence is not used.

[0136] In addition, in an embodiment of the present application, when the encoder determines the sequence indicator parameter according to the processing order, if the processing order is different from the preset order, the encoder must perform transformation processing on the point cloud data according to the processing order, so the value of the sequence indicator parameter can be set to indicate that the preset order is not used; and if the processing order is the same as the preset order, the encoder can perform transformation processing on the point cloud data according to the preset order, so the value of the sequence indicator parameter can be set to indicate that the preset order is used.

[0137] For example, in the present application, when the encoder performs the setting of the sequence indicator parameter, it may set the value of the sequence indicator parameter to 0 to indicate that the preset sequence is not used, and may set the value of the sequence indicator parameter to 1 to indicate that the preset sequence is used.

[0138] In this application, it will be understood that the order indicator parameter can be characterized through the syntax attr_raht_order_default_flag. Specifically, if the value of attr_raht_order_default_flag is equal to 1, it indicates that a preset order is used; and if the value of attr_raht_order_default_flag is equal to 0, that is, it indicates that a preset order is not used.

[0139] Step 105: A step of performing encoding on the point cloud data to be encoded and writing the encoded bits to the code stream.

[0140] In an embodiment of the present application, the encoder may perform processing on point cloud data according to the processing order, obtain point cloud data to be encoded, perform encoding on the point cloud data to be encoded, and write the encoding bits to a bit stream.

[0141] Through the point cloud encoding method described in steps 101 to 107 above, the encoder does not use the method presented in the prior art, which performs RAHT transformation using a fixed transformation order for the point cloud, for example, by performing RAHT processing using an XYZ order for all point clouds, but rather, in the process of encoding the point cloud, first determines a processing order corresponding to the point cloud data before performing transformation processing, and then performs RAHT transformation using the processing order.

[0142] In this application, regarding the processing order of the three coordinates X, Y, and Z, it can be understood that while the encoder in current G-PCC performs transformation processing according to a fixed order, the point cloud encoding method proposed in this application can adaptively change the processing order of the three coordinates of the encoder in G-PCC, thereby improving encoding efficiency.

[0143] It should be noted that in this application, the flexibility of the processing order is limited to the sequence layer, and the entire point cloud can use the same coordinate processing order, that is, all segments (e.g., slices) within the point cloud use the same coordinate processing order.

[0144] In this application, it will be understood that the encoding unit may first perform preprocessing on the point cloud data before performing encoding on the point cloud data. Specifically, the encoder may reset the X, Y, and Z coordinate axes of the point cloud data, reconfirm the sorting order, and then perform encoding on the point cloud data after preprocessing. In terms of display, the encoding may be performed on the coordinate axis order index number corresponding to the processing order in a manner in which the sequence layer directs preprocessing, i.e., by writing the encoding bits to the code stream, the code stream is transmitted to the decoding unit, after which the decoder decodes the code stream to obtain the decoded point cloud, and postprocessing may be performed on the point cloud according to the preprocessing method directed by the sequence layer. That is, the decoding unit can parse the obtained coordinate axis order index number to determine the processing order indicated by the coordinate axis order index number, thereby adaptively setting the X, Y, and Z coordinate axes of the point cloud data.

[0145] An embodiment of the present application proposes a point cloud encoding method comprising: a step in which an encoder determines the processing order of three-dimensional coordinate axes for point cloud data, which is all or part of the data in the point cloud, during a point cloud encoding process; a step in which a coordinate axis order index number corresponding to the processing order is determined; a step in which encoding is performed on the coordinate axis order index number and the encoding bits are recorded in a code stream; a step in which processing is performed on the point cloud data according to the processing order to obtain the point cloud data to be encoded; and a step in which encoding is performed on the point cloud data to be encoded and the encoding bits are recorded in a code stream. In other words, in an embodiment of the present application, on the encoding side, the encoder first determines the processing order of transformation processing corresponding to the point cloud data, performs RAHT transformation according to the processing order, and simultaneously records the processing order in a code stream and transmits it to a decoder; and on the decoding side, the decoder can perform RAHT transformation according to the processing order through the processing order of transformation processing corresponding to the point cloud data obtained by parsing the code stream. Accordingly, the point cloud encoding and decoding method proposed in this application no longer uses a fixed RAHT transformation order for all or part of the data in the point cloud, and by describing the processing order using grammatical elements in the code stream, the coordinate processing order during the encoding and decoding process can be adaptively changed, and furthermore, the transformation efficiency of RAHT can be fully utilized, thereby solving the problem of low transformation efficiency and significantly improving encoding and decoding efficiency.

[0146] Based on the above embodiments, another embodiment of the present application proposes a method for decoding a point cloud. FIG. 12 is an implementation flowchart 1 of point cloud decoding, and as illustrated in FIG. 12, in an embodiment of the present application, a method in which a decoder performs decoding on point cloud data may include the following steps:

[0147] Step 201: A step of parsing the code stream to obtain the coordinate axis order index number.

[0148] In an embodiment of the present application, the decoder can parse a code stream to obtain a coordinate axis order index number of the point cloud data.

[0149] It should be noted that in an embodiment of the present application, the coordinate axis order index number obtained by the decoder parsing the code stream can be used to indicate the processing order.

[0150] Specifically, in the present application, since the processing order may be any one of six different transformation orders, the coordinate axis order index number obtained by parsing by the decoder may also include six different values.

[0151] In this application, it will be understood that the coordinate axis order index number can be indicated through the syntax axis_coding_order, that is, the processing order of the three coordinate axes X, Y, and Z can be specified through the syntax axis_coding_order. Specifically, based on Table 2 above, the axis_coding_order for the G-PCC standard can be used to perform processing on data within the RecPic[pointIdx][axis] buffer area. For example, when the value of axis_coding_order is equal to 0, i.e., when the processing order is ZYX, if the axis value is equal to 0, the data stored in RecPic[pointIdx][0] is the Z-axis data; if the axis value is equal to 1, the data stored in RecPic[pointIdx][1] is the Y-axis data; and if the axis value is equal to 2, the data stored in RecPic[pointIdx][2] is the X-axis data.

[0152] For example, the grammatical parts corresponding to the coordinate axis order index numbers in the G-PCC standard text are as shown in Table 3 below:

[0153]

[0154] Additionally, in an embodiment of the present application, the decoder can parse a code stream and, when obtaining a coordinate axis order index number, perform parsing on the coordinate axis order index number using an equal-length code parsing method.

[0155] In the present application, it will be understood that an equal-length code is an output codeword of the same length obtained after performing encoding processing using equal-length encoding; in other words, an encoder obtains an equal-length code of the same length after encoding a coordinate axis order index number using an equal-length encoding method.

[0156] Additionally, in an embodiment of the present application, when the decoder obtains a coordinate axis order index number by parsing a code stream, it may parse a code stream corresponding to a data unit of a parameter set among the code streams; wherein the data unit of the parameter set includes a parameter used for decoding point cloud data.

[0157] It should be noted that in the embodiments of the present application, the parameter set may be a parameter set of a sequence layer.

[0158] Additionally, in an embodiment of the present application, the parameter set may be a sequence parameter set.

[0159] As should be noted, in an embodiment of the present application, the data unit of the parameter set may include attribute information of the point cloud data; where the attribute information is a scalar or vector attribute related to a point in the point cloud data.

[0160] In an embodiment of the present application, the data unit of the parameter set may further include geometric information of the point cloud data; whereby it will be understood that the geometric information is Cartesian coordinates associated with a point in the point cloud data.

[0161] In addition, in an embodiment of the present application, when the decoder parses a code stream to obtain a coordinate axis order index number, after receiving the code stream, the coordinate axis order index number can be obtained by parsing a data unit in which auxiliary information of the code stream is located.

[0162] For example, in an embodiment of the present application, the auxiliary information may be video usability information (VUI).

[0163] For example, in an embodiment of the present application, the auxiliary information may be supplementary reinforcement information (SEI).

[0164] In an embodiment of the present application, when a decoder parses a code stream to obtain a coordinate axis order index number, it will be understood that the parsed code stream may be a transmission stream containing point cloud encoded data corresponding to point cloud data. In other words, the code stream may be a transmission stream containing point cloud encoded data.

[0165] Additionally, in an embodiment of the present application, when an encoder performs encoding on a coordinate axis sequence index number and writes the encoding bits to a code stream, the parsed code stream may be a media file containing point cloud encoded data corresponding to the point cloud data. In other words, the code stream may be a media file containing point cloud encoded data.

[0166] In other words, in the present application, the coordinate axis order index number axis_coding_order can perform encoding in auxiliary information of the SPS (e.g., VUI), can perform encoding in other auxiliary information data units of point cloud data (e.g., SEI), and can be further extended to perform encoding in auxiliary information units of a transmission stream or file format.

[0167] Step 202: A step of determining the processing order for point cloud data during the point cloud decoding process according to the coordinate axis order index number; where the processing order refers to the processing order of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or some data in the point cloud.

[0168] In an embodiment of the present application, the decoder can parse a code stream to obtain a coordinate axis order index number, and then determine the processing order for the point cloud data during the point cloud decoding process according to the coordinate axis order index number.

[0169] In this application, the processing order refers to the processing order of the coordinate axes of the three-dimensional coordinates of the point cloud data, and it will be understood that the point cloud data is all or part of the data within the point cloud.

[0170] Additionally, in an embodiment of the present application, the processing order may be used to indicate the processing order of the coordinate axes of the three-dimensional coordinates of the point cloud data.

[0171] In the embodiments of the present application, the point cloud data may be all data within the point cloud, and accordingly, it will be understood that the decoder determines the processing order for the point cloud data during the point cloud decoding process according to the coordinate axis order index number. That is, the processing order of all data within the point cloud is determined; in other words, in the present application, for each point within the point cloud, the decoder can perform transformation processing by adopting the same processing order.

[0172] Furthermore, in an embodiment of the present application, the decoder may perform segmentation on the point cloud to obtain a plurality of slices corresponding to the point cloud; thus, the point cloud data may be part of the data within the point cloud, that is, the point cloud may be any one of the slice data within the point cloud. Correspondingly, the decoder determines the processing order for the point cloud data during the point cloud decoding process according to the coordinate axis order index number, that is, determines the processing order of any one of the slice data within the point cloud. In other words, in the present application, for each point of the same slice within the point cloud, the decoder may perform transformation processing by adopting the same processing order.

[0173] In an embodiment of the present application, the processing order is the transformation order used during RAHT transformation, and each point in the point cloud is X, Y, and Z three-dimensional point cloud data. Therefore, the processing order indicates the order of performing transformations sequentially on the three coordinate axes of X, Y, and Z.

[0174] For example, in an embodiment of the present application, when performing RAHT on point cloud attribute information in a hierarchical manner, RAHT is performed alternately for each node along three axes based on the processing order at each layer. For example, if the processing order is XYZ order, the decoder performs RAHT on nodes in the point cloud in the order of X first, then Y, and finally Z; if the processing order is YZX order, the decoder may perform RAHT on nodes in the point cloud in the order of Y first, then Z, and finally X.

[0175] In the embodiments of the present application, since each point in the point cloud is a three-dimensional point cloud data of X, Y, and Z, the order in which the decoder performs RAHT transformation may include six different combinations. That is, it can be understood that the processing order may be six different transformation orders.

[0176] Specifically, for each different processing order, the encoder can set different coordinate axis order index numbers. Correspondingly, since the processing order can be any one of six different transformation orders, the coordinate axis order index numbers can also include six different values.

[0177] In the present application, it will be understood that the processing order of point cloud data may be any one of the ZYX order, XYZ order, XZY order, YZX order, ZXY order, and YXZ order; where X, Y, and Z are the coordinate axes of the three-dimensional coordinates of the point cloud data.

[0178] In addition, in an embodiment of the present application, when the decoder determines the processing order for point cloud data during the point cloud decoding process according to the coordinate axis order index number, the processing order corresponding to the coordinate axis order index number can be determined according to the correspondence table between the preset index number and the processing order.

[0179] Specifically, in the present application, Table 1 is a correspondence table 1 between a preset index number and a processing order, and as shown in Table 1, for each different processing order, the corresponding coordinate axis order index number can be determined by looking up the correspondence table between the preset index number and the processing order.

[0180] For example, in the present application, when a decoder determines the processing order of point cloud data during a point cloud decoding process according to a coordinate axis order index number, if the value of the coordinate axis order index number is 0 or 4, the decoder may determine the processing order of the corresponding point cloud data in ZYX order; if the value of the coordinate axis order index number is 1 or 7, the decoder may determine the processing order of the corresponding point cloud data in XYZ order; if the value of the coordinate axis order index number is 2, the decoder may determine the processing order of the corresponding point cloud data in XZY order; if the value of the coordinate axis order index number is 3, the decoder may determine the processing order of the corresponding point cloud data in YZX order; if the value of the coordinate axis order index number is 5, the decoder may determine the processing order of the corresponding point cloud data in ZXY order; and if the value of the coordinate axis order index number is 6, the decoder may determine the processing order of the corresponding point cloud data in YXZ order.

[0181] It should be noted that in this application, G-PCC does not have the concept of specific X, Y, and Z coordinate axes, and in general, the coordinate axis processing order can be represented as 0, 1, and 2 based on the X, Y, and Z coordinate axes. For example, if the processing order is XYZ order, it can be indicated as 0-1-2.

[0182] Based on Table 1 above, Table 2 is a correspondence table 2 between a preset index number and a processing order, and as shown in Table 2, for each different processing order, the corresponding coordinate axis order index number can be determined by looking up the correspondence table between the preset index number and the processing order.

[0183] For example, in the present application, when a decoder determines the processing order for point cloud data during a point cloud decoding process according to a coordinate axis order index number, if the value of the coordinate axis order index number is 0 or 4, i.e., if the processing order is indicated via 2-1-0, the decoder may determine the processing order of the corresponding point cloud data in ZYX order; if the value of the coordinate axis order index number is 1 or 7, i.e., if the processing order is indicated via 0-1-2, the decoder may determine the processing order of the corresponding point cloud in XYZ order; if the value of the coordinate axis order index number is 2, i.e., if the processing order is indicated via 0-2-1, the decoder may determine the processing order of the corresponding point cloud in XZY order; and if the value of the coordinate axis order index number is 3, i.e., if the processing order is indicated via 2-0-1, the decoder may determine the processing order of the corresponding point cloud in YZX order. If the value of the coordinate axis order index number is 5, that is, if the processing order is indicated through 1-2-0, the decoder can determine the processing order of the corresponding point cloud in ZXY order; and if the value of the coordinate axis order index number is 6, that is, if the processing order is indicated through 1-0-2, the decoder can determine the processing order of the corresponding point cloud in YXZ order.

[0184] In this application, it will be understood that the coordinate axis order index number can be indicated through the syntax axis_coding_order, that is, the processing order of the three coordinate axes X, Y, and Z can be specified through the syntax axis_coding_order. Specifically, based on Table 2 above, the axis_coding_order for the G-PCC standard can be used to perform processing on data within the RecPic[pointIdx][axis] buffer area. For example, if the value of axis_coding_order is equal to 0, i.e., the processing order is ZYX, if the axis value is equal to 0, i.e., what is stored in RecPic[pointIdx][0] is Z-axis data; if the axis value is equal to 1, i.e., what is stored in RecPic[pointIdx][1] is Y-axis data; and if the axis value is equal to 2, i.e., what is stored in RecPic[pointIdx][2] is X-axis data.

[0185] Step 203: A step of parsing the code stream to obtain restored data of the point cloud data.

[0186] In an embodiment of the present application, the decoder may parse a code stream to obtain restored data of the point cloud data.

[0187] Step 204: A step of determining the coordinate data location of the point cloud data among the storage units of the restored data according to the processing order.

[0188] In an embodiment of the present application, the decoder determines the processing order for point cloud data during the point cloud decoding process according to the coordinate axis order index number, parses the code stream to obtain the restored data of the point cloud data, and then determines the coordinate data location of the point cloud data among the storage units of the restored data according to the processing order.

[0189] In other words, in the present application, the processing order indicates a coordinate axis corresponding to the data sequentially output by the decoder after performing a RAHT transformation (i.e., inverse RAHT transformation) on the restored data obtained by parsing the code stream.

[0190] In addition, in an embodiment of the present application, when the decoder determines the location of the coordinate data of the point cloud data among the storage units of the restored data according to the processing order, the coordinate data of the point among the point cloud data can be obtained from the storage units of the restored data according to the coordinate axis order indicated by the processing order.

[0191] In the present application, when performing RAHT conversion, based on the processing order of the RAHT converted data, data acquired first is recorded in the data storage unit first, and data acquired later is recorded in the data storage unit later; that is, it will be understood that the recording order of data corresponds to the order of the coordinate axes.

[0192] Specifically, in an embodiment of the present application, the decoder can perform RAHT processing on the point cloud data in the corresponding coordinate axis direction sequentially according to the processing order when determining the coordinate data location of the point cloud data among the storage units of the restored data.

[0193] It should be noted that in the present application, the execution process of the RAHT transformation is sequentially performed first in one coordinate direction, then in another coordinate direction, and finally in a third coordinate direction.

[0194] As should be noted, in an embodiment of the present application, when the decoder performs RAHT processing on point cloud data sequentially in the direction of the corresponding coordinate axis according to the processing order, it first parses the code stream to determine the Morton code of the node among the point cloud data, and then performs RAHT transformation on the point cloud data according to the processing order and the Morton code.

[0195] Specifically, in an embodiment of the present application, the decoder first calculates and obtains the Morton code of each node in the point cloud data, then sorts the Morton codes for the nodes in the point cloud data in ascending order, and finally traverses each node in the point cloud data according to the sorted order.

[0196] In an embodiment of the present application, the processing order is the conversion order when executing RAHT conversion on point cloud attribute information, and thus, after determining the processing order, the decoder can perform RAHT conversion using point cloud data corresponding to the processing order.

[0197] It should be noted that in the embodiments of the present application, since the point cloud data may be all data in the point cloud, the processing order may be the conversion order of all data in the point cloud, and furthermore, after the decoder determines the processing order, it may sequentially perform RAHT conversion on each point in the point cloud through the processing order.

[0198] In addition, in an embodiment of the present application, since the point cloud data may be part data of the point cloud, that is, since the point cloud data may be slice data of any one of the point clouds, the processing order may be the conversion order of the part data of the point cloud, and thus the decoder may determine the processing order corresponding to any one slice of the point cloud and then sequentially perform RAHT conversion on each point of the slice according to the processing order.

[0199] In other words, in the present application, if the processing order is the transformation order of all data in the point cloud, that is, the decoder can perform RAHT transformation using the same transformation order for all data in the point cloud; if the processing order is the transformation order of some data in the point cloud, that is, the decoder can perform RAHT transformation using the same transformation order for some data in the point cloud, for example, for data in one slice after splitting, RAHT transformation can be performed using the same transformation order.

[0200] In addition, in an embodiment of the present application, when a decoder performs a RAHT transformation on point cloud data according to a processing order and a Morton code, it can determine whether the processing order of the point cloud data is the same as the preset order by first comparing the processing order with a preset order.

[0201] In the embodiments of the present application, it will be understood that the preset order may be a default conversion order stored in advance by the decoder. For example, the decoder may set the ZYX order as the preset order.

[0202] In addition, in an embodiment of the present application, the decoder performs a comparison between the processing order and the preset order, and if the processing order is the same as the preset order, the decoder can directly perform RAHT transformation on the point cloud data according to the preset order and Morton code; if the processing order is different from the preset order, the decoder can perform RAHT transformation on the point cloud data according to the processing order and Morton code.

[0203] As should be noted, in an embodiment of the present application, FIG. 13 is an implementation flowchart 2 of point cloud decoding, and as illustrated in FIG. 12, before the decoder parses the code stream to obtain a coordinate axis order index number, i.e., before step 201, the method by which the decoder performs decoding on the point cloud data may further include the following steps:

[0204] Step 205: A step of parsing a code stream to determine a sequence indicator parameter; where the sequence indicator parameter is to indicate whether to use a preset sequence.

[0205] Step 206: A step in which the value of the order indicator parameter indicates that the preset order is not used, i.e., the processing order is determined to be different from the preset order.

[0206] Step 207: If the value of the order indicator parameter indicates that a preset order is used, that is, if the processing order is confirmed to be the same as the preset order.

[0207] In an embodiment of the present application, the decoder may also first determine a sequence indicator parameter corresponding to point cloud data through code stream parsing, and then determine whether to perform conversion processing using a preset order according to the sequence indicator parameter.

[0208] It should be noted that, in the embodiment of the present application, the sequence indicator parameter may be intended to indicate whether a preset sequence is used. In other words, if the encoding unit performs conversion processing using a preset sequence, the sequence indicator parameter obtained by the decoder through parsing may indicate that the preset sequence is used; if the encoding unit does not perform conversion processing using a preset sequence, that is, if the sequence indicator parameter obtained by the decoder through parsing may indicate that the preset sequence is not used.

[0209] Additionally, in an embodiment of the present application, after the decoder obtains a sequence indicator parameter through parsing, if the value of the sequence indicator parameter indicates that a preset sequence is not used, the decoder must perform transformation processing on the point cloud data according to the processing order; and if the value of the sequence indicator parameter indicates that a preset sequence is used, the decoder can perform transformation processing on the point cloud data according to the preset sequence.

[0210] For example, in the present application, if the value of the sequence indicator parameter is 0, it may be considered to indicate that a preset sequence is not used, and if the value of the sequence indicator parameter is 1, it may be considered to indicate that a preset sequence is used.

[0211] In this application, it will be understood that the order indicator parameter can be characterized through the syntax attr_raht_order_default_flag. Specifically, if the value of attr_raht_order_default_flag is equal to 1, it indicates that a preset order is used; and if the value of attr_raht_order_default_flag is equal to 0, that is, it indicates that a preset order is not used.

[0212] Through the point cloud decoding method presented in steps 201 to 207 above, the decoder no longer uses the method presented in the prior art, which performs RAHT transformation using a fixed transformation order for the point cloud, for example, by performing RAHT processing using an XYZ order for all point clouds, and in the process of decoding the point cloud, first determines a processing order corresponding to the point cloud data before performing transformation processing, and then performs RAHT transformation using the processing order.

[0213] In this application, regarding the processing order of the three coordinates X, Y, and Z, it can be understood that while the decoder in current G-PCC performs transformation processing according to a fixed order, the point cloud encoding method proposed in this application can adaptively change the processing order of the three coordinates of the decoder in G-PCC, thereby improving decoding efficiency.

[0214] It should be noted that in this application, the flexibility of the processing order is limited to the sequence layer, and the entire point cloud can use the same coordinate processing order, that is, all segments (e.g., slices) within the point cloud use the same coordinate processing order.

[0215] In this application, it will be understood that the encoding unit may perform preprocessing on the point cloud data before performing encoding on the point cloud data. Specifically, the encoder may reset the X, Y, and Z coordinate axes of the point cloud data, re-determine the sorting order, and then perform encoding on the point cloud data after preprocessing. In terms of display, the sequence layer may instruct the preprocessing in a manner that, i.e., by performing encoding on the coordinate axis order index number corresponding to the processing order, and then writing the encoding bits to the code stream, the code stream is transmitted to the decoding unit, after which the decoder decodes the code stream to obtain the decoded point cloud, and postprocessing can be performed on the point cloud according to the preprocessing method instructed by the sequence layer. That is, the decoding unit can parse the obtained coordinate axis order index number to determine the processing order indicated by the coordinate axis order index number, thereby adaptively setting the X, Y, and Z coordinate axes of the point cloud data.

[0216] An embodiment of the present application proposes a point cloud decoding method comprising: a step in which a decoder parses a code stream to obtain a coordinate axis order index number; a step in which, according to the coordinate axis order index number, a three-dimensional coordinate processing order is determined for point cloud data, which is all or part of the data in the point cloud during the point cloud decoding process; a step in which a code stream is parsed to obtain restored data of the point cloud data; and a step in which, according to the processing order, a position of the coordinate data of the point cloud data is determined among the storage units of the restored data. In other words, in an embodiment of the present application, on the encoding side, the encoder first determines the processing order of the transformation processing corresponding to the point cloud data and performs RAHT transformation according to the processing order, while simultaneously recording the processing order in the code stream and transmitting it to the decoder; and on the decoding side, the decoder can perform RAHT transformation according to the processing order by determining the processing order of the transformation processing corresponding to the point cloud data obtained through the parsing of the code stream. Accordingly, the point cloud encoding and decoding method proposed in this application no longer uses a fixed RAHT transformation order for all or part of the data in the point cloud, and by describing the processing order using grammatical elements in the code stream, the coordinate processing order during the encoding and decoding process can be adaptively changed, and furthermore, the transformation efficiency of RAHT can be fully utilized, thereby solving the problem of low transformation efficiency and significantly improving encoding and decoding efficiency.

[0217] Based on the above embodiments, another embodiment of the present application proposes a point cloud encoding and decoding method. Compared to the prior art, in the embodiment of the present application, the codec can change a fixed conversion order, that is, by changing a default order that is not transmitted, so that, regardless of whether it is an encoding or decoding stage, a processing order corresponding to the point cloud data is determined before performing RAHT conversion on the point cloud, and then RAHT conversion is performed using the processing order. The conversion process of the decoding stage is described exemplarily below.

[0218] For example, in a certain embodiment, the decoder parses a code stream and obtains the processing order XYZ of the point cloud data. Here, the point cloud data is a portion of the data in the point cloud, i.e., a slice of the point cloud, and the processing order is different from the fixed preset order ZYX. Subsequently, the decoder can perform a point alignment process on the slice based on the Morton code.

[0219] Here, during the octree node decoding process, the spatial position of points among all used children is determined by the number of repeating points among each child and the use of direct encoding positions, as follows:

[0220]

[0221] In a Morton code-based point sorting process, the decoder can parse the code stream to obtain the array McodeBeforeSort[i], where i = 0...PointNum-1 and is as follows:

[0222]

[0223] Typically, from the perspective of the encoding process or encoder, grammar elements are transmitted as a bitstream to indicate information, and from the perspective of the decoding process or decoder, grammar elements are parsed from the bitstream to obtain the indicating information.

[0224] For example, in a certain embodiment, the processing order can be passed to the attribute parameter set grammar, that is, the decoder can obtain the processing order through parsing the code stream of the attribute parameter set. Here, the grammar of the attribute parameter set is as shown in Table 4.

[0225]

[0226] Specifically, in the present application, the coordinate axis order index number attr_raht_order_index may indicate the processing order used in the node, i.e., the RAHT transformation order. In the bit stream, the value of attr_raht_order_index may be 0, 1, 2, 3, 4, 5, 6, or 7. According to Table 1 above, the decoder may determine the corresponding processing order based on the attr_raht_order_index obtained by parsing, and then execute a Morton code-based point alignment process according to the processing order.

[0227] For example, in a certain embodiment, among the set of attribute parameters, a flag may first be passed to indicate whether to use the default transformation order, i.e., whether to use the preset order, and if not to use it, the coordinate axis order index number attr_raht_order_index may be passed to indicate a transformation order other than the preset order.

[0228] In other words, in the present application, the decoder can obtain a sequence indicator parameter after parsing a code stream of a set of attribute parameters; wherein the sequence indicator parameter is intended to indicate whether to use a preset sequence. Herein, the grammar of the set of attribute parameters is as shown in Table 5:

[0229]

[0230] In this application, it will be understood that the order indicator parameter can be characterized through the syntax attr_raht_order_default_flag. Specifically, if the value of attr_raht_order_default_flag is 1, that is, it indicates that a preset order is used; and if the value of attr_raht_order_default_flag is 0, that is, it indicates that a preset order is not used.

[0231] In addition, in an embodiment of the present application, if the value of attr_raht_order_default_flag is equal to 0, that is, if no preset order is used, the decoder can further determine the processing order used through the coordinate axis order index number attr_raht_order_index obtained by parsing.

[0232] In this application, it will be understood that if the preset order is the XYZ order, the value of the coordinate axis order index number attr_raht_order_index obtained by parsing by the decoder can be used to indicate five other types of transformation orders other than the XYZ order. In other words, in this application, based on the determination of the order indication parameter attr_raht_order_default_flag, the coordinate axis order index number attr_raht_order_index is used to indicate a transformation order other than the preset order.

[0233]

[0234] In addition, in the present application, the coordinate axis order index number attr_raht_order_index indicates the RAHT order for the node (other than the default preset order), i.e., indicates the processing order. In the bit stream, the value of attr_raht_order_index must be 0, 1, 2, 3, or 4. Table 6 is a correspondence table 3 between the preset index number and the processing order, where the preset order is XYZ, and as shown in Table 6, based on the value of the coordinate axis order index number, the decoder can look up the correspondence table between the preset index number and the processing order to determine the corresponding processing order.

[0235] In addition, in the present application, the decoder parses a code stream of a set of attribute parameters to obtain an order indicator parameter attr_raht_order_default_flag, and if the value of attr_raht_order_default_flag is equal to 1, that is, indicates that a preset order is used, the decoder can execute a Morton code-based point alignment process according to the preset order.

[0236] In addition, in the present application, the decoder parses a code stream of a set of attribute parameters to obtain an order indicator parameter attr_raht_order_default_flag, and if the value of attr_raht_order_default_flag is equal to 0, that is, it indicates that a preset order is used, the decoder continues to parse the code stream to obtain a coordinate axis order index number attr_raht_order_index to determine the processing order, and accordingly, can execute a Morton code-based point alignment process according to the preset order.

[0237] For example, in a certain embodiment, the processing order is passed to a set of attribute parameters, excluding the descriptor ue(V) (i.e., Exp-Golomb code) of the grammar element attr_raht_order_index. In terms of encoding, the descriptor corresponds to the entropy encoding method of the grammar element, and in terms of decoding, the descriptor corresponds to the parsing process of the grammar element.

[0238] In this application, it can be understood that the processing order of the RAHT transformation is passed to a set of attribute parameters and is applied to perform encoding or decoding on one or more slices associated with the set of attribute parameters.

[0239] For example, in a certain embodiment, the processing order with or without a preset order is passed as an attribute slice header. The syntax of the attribute slice header is as shown in Table 7:

[0240]

[0241] In this application, it will be understood that the processing order passed to the attribute slice header is used only to perform encoding or decoding on said slice.

[0242] For example, in a certain embodiment, a processing order with or without a preset order is passed to an attribute parameter set and an attribute slice header associated with said attribute parameter set. The processing order passed to the attribute slice header can override the determined processing order by performing parsing on the attribute parameter set.

[0243] Specifically, in the present application, the processing order is conveyed as a set of attribute parameters, wherein the syntax of the set of attribute parameters is as shown in Table 8:

[0244]

[0245] In addition, in an embodiment of the present application, the syntax of the attribute slice header is as shown in Table 9:

[0246]

[0247] In the present application, it can be understood that after the decoder parses the code stream, it may obtain the grammar element ash_attr_raht_order_override_flag; where the grammar element ash_attr_raht_order_override_flag is used to indicate whether to use the processing order passed to the set of attribute parameters.

[0248] Additionally, in an embodiment of the present application, if the value of ash_attr_raht_order_override_flag is equal to 0, that is, the processing order passed to the set of attribute parameters associated with the slice is used.

[0249] In addition, in an embodiment of the present application, if the value of ash_attr_raht_order_override_flag is equal to 1, that is, if it indicates the use of the processing order indicated by ash_attr_raht_index, the decoder can obtain ash_attr_raht_index through parsing and further determine the processing order to be used. Specifically, the decoder can further obtain the processing order indicated by ash_attr_raht_index through Table 1.

[0250] In an embodiment of the present application, if the value of ash_attr_raht_order_override_flag is equal to 1, that is, if it indicates the use of the processing order indicated by ash_attr_raht_index, the decoder may remove the processing order already passed to the set of attribute parameters associated with the slice (i.e., the set of active attribute parameters) and dynamically determine it. For example, if the processing order passed to the set of active attribute parameters is ZYX, the encoder or decoder may construct a correspondence table between the preset index number and the processing order in an order other than the ZYX order. Here, in the bit stream, the value of attr_raht_order_index must be equal to 0, 1, 2, 3, or 4. Table 10 is a correspondence table 4 between a preset index number and a processing order. If the processing order passed to the dual active attribute parameter set is ZYX, the decoder can determine the corresponding processing order by looking up the correspondence table between the preset index number and the processing order based on the value of the coordinate axis order index number ash_attr_raht_index as shown in Table 10.

[0251]

[0252] In the present application, it can be understood that if ash_attr_raht_order_index is an encoded or parsed ue(v), bits for indicating ash_attr_raht_order_index in the bit stream can be saved.

[0253] Additionally, in this application, when attr_coding_type among the attribute parameter sets is equal to 1, an additional flag, such as attr_raht_order_override_allowed_flag, is passed (in the view of encoding or an encoder) or parsed (in the view of decoding or a decoder) to indicate whether the processing order of RAHT transformations detailed in the attribute slice header associated with the attribute parameter set is allowed to override the processing order of RAHT transformations detailed in the attribute parameter set. For attr_raht_order_override_allowed_flag, the syntax of the attribute slice header is as shown in Table 11:

[0254]

[0255] In addition, in the present application, the decoder can parse a code stream to obtain a processing order, and then execute a Morton code-based point alignment process according to a preset order.

[0256] Embodiments of the present application disclose a point cloud encoding and decoding method, an encoder, a decoder, and a computer storage medium. In the point cloud encoding process, the encoder determines the processing order of three-dimensional coordinate axes for point cloud data, which is all or part of the data in the point cloud; determines a coordinate axis order index number corresponding to the processing order; performs encoding on the coordinate axis order index number and writes the encoding bits to a code stream; performs processing on the point cloud data according to the processing order to obtain the point cloud data to be encoded; and performs encoding on the point cloud data to be encoded and writes the encoding bits to a code stream. The decoder parses the code stream to obtain the coordinate axis order index number; determines the processing order of three-dimensional coordinate axes for point cloud data, which is all or part of the data in the point cloud, in the point cloud decoding process according to the coordinate axis order index number; parses the code stream to obtain the restored data of the point cloud data; and determines the location of the coordinate data of the point cloud data among the storage units of the restored data according to the processing order. In other words, in an embodiment of the present application, at the encoding side, the encoder first determines the processing order of the transformation processing corresponding to the point cloud data and performs RAHT transformation according to the processing order, and at the same time records the processing order in a code stream and transmits it to the decoder, and at the decoding side, the decoder obtains the processing order of the transformation processing corresponding to the point cloud data through parsing the code stream and performs RAHT transformation according to the processing order.Accordingly, the point cloud encoding and decoding method proposed in this application no longer uses a fixed RAHT transformation order for all or part of the data in the point cloud, and by describing the processing order using grammatical elements in the code stream, the coordinate processing order during the encoding and decoding process can be adaptively changed, and furthermore, the transformation efficiency of RAHT can be fully utilized, thereby solving the problem of low transformation efficiency and significantly improving encoding and decoding efficiency.

[0257] Based on the above embodiment, in another embodiment of the present application, FIG. 14 is a structural diagram of an encoder, and as shown in FIG. 14, the encoder (300) proposed by the embodiment of the present application may include a first determination part (301), an encoding part (302), and a conversion part (303).

[0258] The first determination part (301) is configured to determine the processing order for point cloud data during the point cloud encoding process; whereby the processing order refers to the processing order of the coordinate axes of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud;

[0259] The above encoding part (302) is configured to perform encoding on the coordinate axis order index number and write the encoding bit to the code stream;

[0260] The above conversion part (303) is configured to perform processing on the point cloud data according to the above processing order to obtain the point cloud data to be encoded;

[0261] The above encoding part (302) is also configured to perform encoding on the point cloud data to be encoded and write the encoding bits to the code stream.

[0262] In addition, in an embodiment of the present application, the first determination part (301) is specifically configured to determine the processing order according to the moton code of the node among the point cloud data.

[0263] In addition, in an embodiment of the present application, the processing order is any one of the ZYX order, XYZ order, XZY order, YZX order, ZXY order, and YXZ order, where X, Y, and Z are the coordinate axes of the three-dimensional coordinates of the point cloud data.

[0264] In addition, in an embodiment of the present application, the determination portion (301) is also configured to set the value of the coordinate axis order index number corresponding to the processing order, specifically according to a correspondence table between a preset index number and a processing order.

[0265] In addition, in an embodiment of the present application, the correspondence table between the preset index number and the processing order is as follows:

[0266]

[0267] Additionally, in an embodiment of the present application, the encoding portion (302) is configured to perform encoding for the coordinate axis order index number specifically using an equal length encoding method.

[0268] Additionally, in an embodiment of the present application, the encoding portion (302) is further configured to specifically write the encoding bits to a code stream corresponding to a data unit of a parameter set; wherein the data unit of the parameter set includes a parameter used to decode the point cloud data.

[0269] In addition, in an embodiment of the present application, the parameter set is a parameter set of a sequence layer.

[0270] In addition, in an embodiment of the present application, the parameter set is a sequence parameter set.

[0271] Additionally, in an embodiment of the present application, the data unit of the parameter set includes attribute information of the point cloud data; wherein the attribute information is a scalar or vector attribute related to a point in the point cloud data.

[0272] Additionally, in an embodiment of the present application, the data unit of the parameter set includes geometric information of the point cloud data; wherein the geometric information is Cartesian coordinates associated with a point in the point cloud data.

[0273] Additionally, in an embodiment of the present application, the transformation part (303) is configured to perform coordinate mapping processing on the point cloud data, specifically according to the processing order.

[0274] Additionally, in an embodiment of the present application, the transformation part (303) is further configured to perform rearrangement on the coordinates of the point cloud data, specifically according to the processing order.

[0275] Additionally, in an embodiment of the present application, the transformation part (303) is further configured to sequentially perform processing on the point cloud data in the direction of the corresponding coordinate axis according to the processing order.

[0276] In addition, in an embodiment of the present application, the transformation part (303) is further configured to perform RAHT processing on the point cloud data sequentially in the direction of the corresponding coordinate axis, specifically according to the processing order.

[0277] In addition, in an embodiment of the present application, the transformation part (303) is further configured to specifically determine the Morton code of a node among the point cloud data and to perform RAHT transformation on the point cloud data according to the processing order and the Morton code.

[0278] Additionally, in an embodiment of the present application, the transformation part (303) is further configured to perform RAHT transformation on the point cloud data according to the pre-set order and the Morton code, specifically if the processing order is the same as the pre-set order; and to perform RAHT transformation on the point cloud data according to the processing order and the Morton code, if the processing order is different from the pre-set order.

[0279] Additionally, in an embodiment of the present application, the first determination portion (301) is further configured to determine a sequence indication parameter for indicating whether to use the preset sequence according to the processing order, after determining the processing order for the point cloud data in the point cloud encoding process and before determining the coordinate axis sequence index number corresponding to the processing order;

[0280] The above encoding part (302) is further configured to perform encoding on the above sequence indicator parameter and write the encoding bit to the code stream.

[0281] Additionally, in an embodiment of the present application, the first determination portion (301) is further configured such that, specifically, if the processing order is different from the preset order, that is, if the value of the sequence indicator parameter is set to indicate that the preset order is not used; and if the processing order is the same as the preset order, that is, if the value of the sequence indicator parameter is set to indicate that the preset order is used.

[0282] Additionally, in an embodiment of the present application, the encoding portion (302) is further specifically configured to record the encoding bits in a data unit where auxiliary information of the code stream is located.

[0283] Additionally, in an embodiment of the present application, the auxiliary information is video usability information (VUI).

[0284] Additionally, in an embodiment of the present application, the auxiliary information is supplementary reinforcement information (SEI).

[0285] Additionally, in an embodiment of the present application, the encoding portion (302) is also specifically configured to write the encoding bits to a transmission stream containing point cloud encoding data corresponding to the point cloud data.

[0286] Additionally, in an embodiment of the present application, the encoding portion (302) is further specifically configured to record the encoding bits in a media file containing point cloud encoding data corresponding to the point cloud data.

[0287] FIG. 15 is a diagram illustrating the configuration structure of an encoder, and as shown in FIG. 15, the encoder (300) proposed by the embodiment of the present application may further include a first processor (304), a first memory (305) in which an executable instruction of the first processor (304) is stored, a first communication interface (306), and a first bus (307) for connecting the first processor (304), the first memory (305), and the first communication interface (306).

[0288] Additionally, in an embodiment of the present application, the first processor (304) determines the processing order of the three-dimensional coordinate axes for the point cloud data, which is all or part of the data in the point cloud during the point cloud encoding process; determines a coordinate axis order index number corresponding to the processing order; performs encoding on the coordinate axis order index number and records the encoding bits in a code stream; performs processing on the point cloud data according to the processing order to obtain the point cloud data to be encoded; and performs encoding on the point cloud data to be encoded and records the encoding bits in a code stream.

[0289] If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it may be stored on a computer-readable storage medium. Based on this understanding, the technical solution of the present embodiment, or a part contributing to the prior art, or all or part of the technical solution may be embodied in the form of a software product. The computer software product may be stored on a storage medium containing a few instructions to enable a computer device (which may be a personal computer, server, or network equipment, etc.) or a processor to execute all or part of the steps of the method of the present embodiment. The aforementioned storage medium includes various media capable of storing program code, such as a U disk, a removable hard disk, Read Only Memory (ROM), Random Access Memory (RAM), a magnetic disk, or an optical disk.

[0290] An embodiment of the present application provides an encoder, wherein the encoder determines the processing order of three-dimensional coordinate axes for point cloud data, which is all or part of the data in the point cloud during the point cloud encoding process; determines a coordinate axis order index number corresponding to the processing order; performs encoding on the coordinate axis order index number and records the encoding bits in a code stream; performs processing on the point cloud data according to the processing order to obtain the point cloud data to be encoded; and performs encoding on the point cloud data to be encoded and records the encoding bits in a code stream. In other words, in an embodiment of the present application, on the encoding side, the encoder first determines the processing order of the transformation processing corresponding to the point cloud data, performs RAHT transformation according to the processing order, and simultaneously records the processing order in a code stream and transmits it to a decoder; and on the decoding side, the decoder obtains the processing order of the transformation processing corresponding to the point cloud data through parsing the code stream, thereby performing RAHT transformation according to the processing order. Accordingly, the point cloud encoding and decoding method proposed in this application no longer uses a fixed RAHT transformation order for all or part of the data in the point cloud, and by describing the processing order using grammatical elements in the code stream, the coordinate processing order during the encoding and decoding process can be adaptively changed, and furthermore, the transformation efficiency of RAHT can be fully utilized, thereby solving the problem of low transformation efficiency and significantly improving encoding and decoding efficiency.

[0291] FIG. 16 is a diagram illustrating the configuration structure of a decoder, and as shown in FIG. 16, the decoder (400) proposed by an embodiment of the present application may include a parsing part (401) and a second determination part (402).

[0292] The above parsing part (401) is configured to parse a code stream to obtain a coordinate axis order index number, and

[0293] The second determination part (402) is configured to determine the processing order for point cloud data during the point cloud decoding process according to the coordinate axis order index number; whereby the processing order refers to the processing order of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud;

[0294] The above parsing part (401) is also further configured to parse a code stream to obtain recovery data of the point cloud data;

[0295] The second determination part (402) is also further configured to determine the location of the coordinate data of the point cloud data among the storage units of the plurality of data according to the processing order.

[0296] Additionally, in an embodiment of the present application, the parsing portion (401) is configured to perform parsing for the coordinate axis order index number using a method for parsing codes of the same length, specifically.

[0297] Additionally, in an embodiment of the present application, the parsing portion (401) is further configured to parse a code stream corresponding to a data unit of a parameter set among the code streams, specifically; wherein the data unit of the parameter set includes a parameter used to decode the point cloud data.

[0298] In addition, in an embodiment of the present application, the parameter set is a parameter set of a sequence layer.

[0299] In addition, in an embodiment of the present application, the parameter set is a sequence parameter set.

[0300] Additionally, in an embodiment of the present application, the data unit of the parameter set includes attribute information of the point cloud data; wherein the attribute information is a scalar or vector attribute related to a point in the point cloud data.

[0301] Additionally, in an embodiment of the present application, the data unit of the parameter set includes geometric information of the point cloud data; wherein the geometric information is Cartesian coordinates associated with a point in the point cloud data.

[0302] In addition, in an embodiment of the present application, the processing order is any one of the ZYX order, XYZ order, XZY order, YZX order, ZXY order, and YXZ order, where X, Y, and Z are the coordinate axes of the three-dimensional coordinates of the point cloud data.

[0303] In addition, in an embodiment of the present application, the second determination part (402) is also configured to determine the processing order corresponding to the coordinate axis order index number, specifically according to a correspondence table between a preset index number and a processing order.

[0304] In addition, in an embodiment of the present application, the correspondence table between the preset index number and the processing order is

[0305]

[0306] Includes

[0307] Additionally, in an embodiment of the present application, the second determination portion (402) is further configured to specifically acquire coordinate data of a point in the point cloud data according to the coordinate axis order indicated by the processing order, with respect to the point in the restoration data storage unit.

[0308] In addition, in an embodiment of the present application, the second determination part (402) is further configured to perform RAHT processing on the point cloud data sequentially in the direction of the corresponding coordinate axis, specifically according to the processing order.

[0309] In addition, in an embodiment of the present application, the second determination part (402) is further configured to specifically parse a code stream to determine the Morton code of a node among the point cloud data; and to perform a RAHT transformation on the point cloud data according to the processing order and the Morton code.

[0310] Additionally, in an embodiment of the present application, the second determinant (402) is further configured to perform a RAHT transformation on the point cloud data according to the pre-set order and the Morton code, specifically, if the processing order is the same as the pre-set order; and if the processing order is different from the pre-set order, that is, to perform a RAHT transformation on the point cloud data according to the processing order and the Morton code.

[0311] Additionally, in an embodiment of the present application, the parsing portion (401) is further configured to parse the code stream to determine a sequence indicator parameter before obtaining a coordinate axis sequence index number; wherein the sequence indicator parameter is used to indicate whether to use the preset sequence.

[0312] The second determination part (402) is further configured to determine that if the value of the sequence indicator parameter indicates that the preset sequence is not used, that is, the processing sequence is different from the preset sequence; and if the value of the sequence indicator parameter indicates that the preset sequence is used, that is, the processing sequence is the same as the preset sequence.

[0313] Additionally, in an embodiment of the present application, the parsing portion (401) is further configured to obtain the coordinate axis sequence index number by specifically parsing a data unit in which auxiliary information of the code stream is located.

[0314] Additionally, in an embodiment of the present application, the auxiliary information is video usability information (VUI).

[0315] Additionally, in an embodiment of the present application, the auxiliary information is supplementary reinforcement information (SEI).

[0316] Additionally, in an embodiment of the present application, the parsing portion (401) is further configured to specifically parse a transmission stream containing the point cloud encoding data to obtain the coordinate axis order index number.

[0317] Additionally, in an embodiment of the present application, the parsing portion (401) is further configured to specifically parse a media file containing the point cloud encoding data to obtain the coordinate axis order index number.

[0318] FIG. 17 is a diagram illustrating the configuration structure of a decoder, and as shown in FIG. 17, the decoder (400) proposed by the embodiment of the present application may further include a second processor (403), a second memory (404) in which instructions executable by the second processor (403) are stored, a second communication interface (405), and a second bus (406) for connecting the second processor (403), the second memory (404), and the second communication interface (405).

[0319] Additionally, in an embodiment of the present application, the second processor (403) parses a code stream to obtain a coordinate axis order index number; determines the three-dimensional coordinate processing order for point cloud data, which is all or part of the data in the point cloud during the point cloud decoding process, according to the coordinate axis order index number; parses a code stream to obtain restored data of the point cloud data; and determines the location of the coordinate data of the point cloud data among the storage units of the restored data according to the processing order.

[0320] If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it may be stored on a computer-readable storage medium. Based on this understanding, the technical solution of the present embodiment, or a part contributing to the prior art, or all or part of the technical solution may be embodied in the form of a software product. The computer software product may be stored on a storage medium containing a few instructions to enable a computer device (which may be a personal computer, server, or network equipment, etc.) or a processor to execute all or part of the steps of the method of the present embodiment. The aforementioned storage medium includes various media capable of storing program code, such as a U disk, a removable hard disk, Read Only Memory (ROM), Random Access Memory (RAM), a magnetic disk, or an optical disk.

[0321] An embodiment of the present application provides a decoder, wherein the decoder parses a code stream to obtain a coordinate axis order index number; determines the three-dimensional coordinate processing order for point cloud data, which is all or part of the data in the point cloud during the point cloud decoding process, according to the coordinate axis order index number; parses a code stream to obtain restored data of the point cloud data; and determines the position of the coordinate data of the point cloud data among the storage units of the restored data according to the processing order. In other words, in an embodiment of the present application, on the encoding side, the encoder first determines the processing order of the transformation processing corresponding to the point cloud data, performs RAHT transformation according to the processing order, and simultaneously records the processing order in a code stream and transmits it to the decoder; and on the decoding side, the decoder obtains the processing order of the transformation processing corresponding to the point cloud data through parsing a code stream, thereby performing RAHT transformation according to the processing order. Accordingly, the point cloud encoding and decoding method proposed in this application no longer uses a fixed RAHT transformation order for all or part of the data in the point cloud, and by describing the processing order using grammatical elements in the code stream, the coordinate processing order during the encoding and decoding process can be adaptively changed, and furthermore, the transformation efficiency of RAHT can be fully utilized, thereby solving the problem of low transformation efficiency and significantly improving encoding and decoding efficiency.

[0322] An embodiment of the present application provides a computer-readable storage medium in which a program is stored and the computer-readable storage medium, and when the program is executed by a processor, the method as described in the embodiment is implemented.

[0323] Specifically, the program instruction corresponding to the encoding method in the present embodiment may be stored on a storage medium such as an optical disc, a hard disc, or a U disc, and when the program instruction corresponding to the encoding method in the storage medium is executed by an electronic device, the following steps are included:

[0324] A step of determining the processing order for point cloud data during the point cloud encoding process; wherein the processing order refers to the processing order of the coordinate axes of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud;

[0325] A step of determining a coordinate axis sequence index number corresponding to the above processing order;

[0326] A step of performing encoding on the above coordinate axis sequence index number and writing the encoding bits to the code stream;

[0327] A step of processing the point cloud data according to the above processing order to obtain point cloud data to be encoded;

[0328] It includes the step of encoding the point cloud data to be encoded and writing the encoding bits to a code stream.

[0329] Specifically, the program instruction corresponding to the decoding method in the present embodiment may be stored on a storage medium such as an optical disk, a hard disk, or a U disk, and when the program instruction corresponding to the decoding method in the storage medium is executed by an electronic device, the following steps are included:

[0330] A step of parsing a code stream to obtain a coordinate axis order index number;

[0331] A step of determining the processing order for point cloud data during the point cloud decoding process according to the above coordinate axis order index number; wherein the processing order refers to the processing order of the three-dimensional coordinate axes of the point cloud data, and the point cloud data is all or part of the data in the point cloud;

[0332] A step of parsing a code stream to obtain restored data of the point cloud data;

[0333] According to the above processing order, the method includes the step of determining the location of the coordinate data of the point cloud data in the storage unit of the restored data.

[0334] Those skilled in the art will understand that embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may adopt the form of hardware embodiments, software embodiments, or embodiments in aspects combining software and hardware. Additionally, the present application may adopt the form of a computer program product implemented on a computer-available storage medium (including, but not limited to, magnetic disk memory and optical memory) containing one or more computer-available program codes.

[0335] This application has been described with reference to implementation flowcharts and / or block diagrams of a method, device (system, and computer program product according to embodiments of this application. It should be understood that computer program instructions can be used to implement each flow and / or block in the flowcharts and / or block diagrams, and to implement combinations of flows and / or blocks in the flowcharts and / or block diagrams. Such computer program instructions may be provided to a processor of a general-purpose computer, a dedicated computer, an embedded processor, or other programmable data processing device for creating a device, and instructions executed through the processor of the computer or other programmable data processing device create a device for implementing a function specified in one flow or multiple flows and / or one block or multiple blocks in the implementation flowcharts and / or block diagrams.

[0336] These computer program instructions are also stored in computer-readable memory that induces a computer or other programmable data processing device to operate in a specific manner, said instructions stored in computer-readable memory can produce a manufactured product including an instruction device, said instruction device implements a function specified in one flow or multiple flows of an implementation flowchart and / or one block or multiple blocks of a block diagram.

[0337] These computer program instructions are also loaded into a computer or other programmable data processing device and, by executing a series of operation steps in the computer or other programmable device to generate processing implemented by the computer, provide a step in which instructions executed in the computer or other programmable device implement a function specified in one flow or multiple flows of an implementation flowchart and / or one block or multiple blocks of a block diagram.

[0338] The above description is merely a preferred embodiment of the present application and is not intended to limit the scope of protection of the present application. Industrial applicability

[0339] Embodiments of the present application disclose a point cloud encoding and decoding method, an encoder, a decoder, and a computer storage medium. In the point cloud encoding process, the encoder determines the processing order of three-dimensional coordinate axes for point cloud data, which is all or part of the data in the point cloud; determines a coordinate axis order index number corresponding to the processing order; performs encoding on the coordinate axis order index number and writes the encoding bits to a code stream; performs processing on the point cloud data according to the processing order to obtain the point cloud data to be encoded; and performs encoding on the point cloud data to be encoded and writes the encoding bits to a code stream. The decoder parses the code stream to obtain the coordinate axis order index number; determines the processing order of three-dimensional coordinate axes for point cloud data, which is all or part of the data in the point cloud, in the point cloud decoding process according to the coordinate axis order index number; parses the code stream to obtain the restored data of the point cloud data; and determines the location of the coordinate data of the point cloud data among the storage units of the restored data according to the processing order. In other words, in an embodiment of the present application, at the encoding side, the encoder first determines the processing order of the transformation processing corresponding to the point cloud data and performs RAHT transformation according to the processing order, and at the same time records the processing order in a code stream and transmits it to the decoder, and at the decoding side, the decoder obtains the processing order of the transformation processing corresponding to the point cloud data through parsing the code stream and performs RAHT transformation according to the processing order.Accordingly, the point cloud encoding and decoding method proposed in this application no longer uses a fixed RAHT transformation order for all or part of the data in the point cloud, and by describing the processing order using grammatical elements in the code stream, the coordinate processing order during the encoding / decoding process can be adaptively changed, and furthermore, the transformation efficiency of RAHT can be fully utilized, thereby solving the problem of low transformation efficiency and significantly improving encoding / decoding efficiency.

Claims

Claim 1 A point cloud encoding method applied to an encoder, wherein the method comprises: a step of determining (101) a processing order for point cloud data during a point cloud encoding process; wherein the processing order refers to a processing order of the three-dimensional coordinates of the point cloud data, and the processing order is any one of ZYX order, XYZ order, XZY order, YZX order, ZXY order, and YXZ order, and X, Y, and Z are the coordinate axes of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud; a step of determining (102) a coordinate axis order index number corresponding to the processing order; a step of performing encoding (103) for the coordinate axis order index number and recording the encoding bits in a code stream (103); a step of processing (104) the point cloud data according to the processing order to obtain the point cloud data to be encoded; and a step of encoding (105) the point cloud data to be encoded and recording the encoding bits in a code stream (105). Claim 2 A point cloud encoding method according to claim 1, wherein the step of determining the processing order for point cloud data during the point cloud encoding process includes the step of determining the processing order according to the Morton code of the node among the point cloud data. Claim 3 A point cloud encoding method according to claim 1, wherein the step of determining a coordinate axis order index number corresponding to the processing order includes the step of setting a value of the coordinate axis order index number corresponding to the processing order according to a correspondence table between a preset index number and the processing order. Claim 4 In paragraph 3, the correspondence table between the above-mentioned preset index number and processing order is A point cloud encoding method including Claim 5 A point cloud decoding method applied to a decoder comprises: a step of parsing a code stream (201) to obtain a coordinate axis order index number; a step of determining (202) a processing order for point cloud data during a point cloud decoding process according to the coordinate axis order index number; wherein the processing order refers to a processing order of the three-dimensional coordinates of the point cloud data, and the processing order is any one of ZYX order, XYZ order, XZY order, YZX order, ZXY order, and YXZ order, and X, Y, and Z are the coordinate axes of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud; a step of parsing a code stream (203) to obtain restored data of the point cloud data; and a step of determining (204) the location of the coordinate data of the point cloud data in a storage unit of the restored data according to the processing order. Claim 6 A point cloud decoding method according to claim 5, wherein the step of parsing the code stream to obtain a coordinate axis order index number includes the step of performing parsing on the coordinate axis order index number using a method for parsing codes of the same length. Claim 7 In claim 5, the step of parsing the code stream to obtain a coordinate axis order index number includes the step of parsing the code stream corresponding to the data unit of the parameter set among the code streams; wherein the data unit of the parameter set includes a parameter used to decode the point cloud data, a point cloud decoding method. Claim 8 A point cloud decoding method according to claim 7, wherein the parameter set is a parameter set of a sequence layer or a sequence parameter set. Claim 9 A point cloud decoding method according to claim 7, wherein the data unit of the parameter set includes attribute information of the point cloud data; wherein the attribute information is a scalar or vector attribute associated with a point among the point cloud data, or the data unit of the parameter set includes geometry information of the point cloud data, and the geometry information is an orthogonal coordinate associated with a point of the point cloud data. Claim 10 A point cloud decoding method according to claim 5, wherein the step of determining the processing order for point cloud data in the cloud data decoding process according to the coordinate axis order index number includes the step of determining the processing order corresponding to the coordinate axis order index number according to a correspondence table between a preset index number and the processing order. Claim 11 In Clause 10, the correspondence table between the above-mentioned preset index number and processing order is A point cloud decoding method including Claim 12 In the encoder (300), the encoder includes a first determination part (301), an encoding part (302), and a conversion part (303), and the first determination part (301) is configured to determine the processing order for point cloud data during the point cloud encoding process; Here, the processing order refers to the processing order of the coordinate axes of the three-dimensional coordinates of the point cloud data, and the processing order is any one of the ZYX order, XYZ order, XZY order, YZX order, ZXY order, and YXZ order, where X, Y, and Z are the coordinate axes of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud; the first determination part (301) is further configured to determine a coordinate axis order index number corresponding to the processing order; the encoding part (302) is configured to perform encoding on the coordinate axis order index number and write the encoding bits to a code stream; the conversion part (303) is configured to perform processing on the point cloud data according to the processing order to obtain the point cloud data to be encoded; and the encoding part (302) is further configured to perform encoding on the point cloud data to be encoded and write the encoding bits to a code stream, an encoder. Claim 13 In the decoder (400), the decoder includes a parsing portion (401) and a second determination portion (402), the parsing portion (401) is configured to parse a code stream to obtain a coordinate axis order index number, and the second determination portion (402) is configured to determine the processing order for point cloud data in the point cloud decoding process according to the coordinate axis order index number; Here, the processing order refers to the processing order of the coordinate axes of the three-dimensional coordinates of the point cloud data, and the processing order is any one of the ZYX order, XYZ order, XZY order, YZX order, ZXY order, and YXZ order, where X, Y, and Z are the coordinate axes of the three-dimensional coordinates of the point cloud data, and the point cloud data is all or part of the data in the point cloud; the parsing part (401) is further configured to parse a code stream to obtain the restored data of the point cloud data; and the second determination part (402) is further configured to determine the position of the coordinate data of the point cloud data in the storage unit of the restored data according to the processing order, a decoder. Claim 14 delete Claim 15 delete Claim 16 delete Claim 17 delete Claim 18 delete Claim 19 delete Claim 20 delete Claim 21 delete Claim 22 delete Claim 23 delete Claim 24 delete Claim 25 delete Claim 26 delete Claim 27 delete Claim 28 delete Claim 29 delete Claim 30 delete Claim 31 delete Claim 32 delete Claim 33 delete Claim 34 delete Claim 35 delete Claim 36 delete Claim 37 delete Claim 38 delete Claim 39 delete Claim 40 delete Claim 41 delete Claim 42 delete Claim 43 delete Claim 44 delete Claim 45 delete Claim 46 delete Claim 47 delete Claim 48 delete Claim 49 delete

Citation Information

Patent Citations

  • Transform method, inverse transform method, coder, decoder and storage medium

    WO2021000205A1

  • K-d tree encoding for point clouds using deviations

    EP3324310A1