Point cloud data processing method, device, electronic device and storage medium
Patent Information
- Application Number
- HK42023081083
- Authority / Receiving Office
- HK · HK
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-10-19
- Publication Date
- 2026-08-28
AI Technical Summary
In existing point cloud data encoding and decoding processes, the computational complexity of isolated point patterns is high, which affects encoding and decoding efficiency.
During the encoding and decoding process, the information of the decoded nodes related to the node to be decoded is determined by acquiring the compressed bitstream of the point cloud data. Based on the information of the decoded nodes, it is determined whether to enter the isolated point mode judgment. If the conditions are not met, the isolated point mode judgment is skipped to optimize the encoding process.
It improves the encoding and decoding efficiency of point cloud data and reduces unnecessary computation steps and resource consumption.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of point cloud encoding and decoding technology. Specifically, this application relates to a point cloud data processing method, apparatus, electronic device, and storage medium. Background Technology
[0002] A point cloud is a set of points in a 3D (three-dimensional) space formed by collecting data from the surface of an object. Point cloud data is often extremely large, posing a significant challenge to its transmission. Therefore, point cloud data typically needs to be compressed before transmission, and this compression can be achieved through encoding.
[0003] Due to the non-uniform spatial distribution of 3D point clouds, an isolated point mode has been proposed for encoding and decoding point cloud data, allowing for independent encoding and decoding of relatively independent points. However, the current isolated point mode has high computational complexity, affecting the encoding and decoding efficiency of point cloud data. Summary of the Invention
[0004] The purpose of this application is to solve the computational problem of how to improve the encoding and decoding efficiency of point cloud data.
[0005] According to a first aspect of the embodiments of this application, a point cloud data processing method is provided, the method comprising:
[0006] Obtain the compressed bitstream of point cloud data;
[0007] For the first node to be decoded in the compressed bitstream, determine the node information of the already decoded second node related to the first node;
[0008] Based on the node information of the decoded second node, determine whether to enter the isolated point mode judgment for the first node;
[0009] If, based on the node information of the already decoded second node, it is determined that the isolation point mode determination for the first node should not be entered, then the isolation point mode determination for the first node is skipped.
[0010] According to a second aspect of the embodiments of this application, a point cloud data processing method is also provided, the method comprising:
[0011] Obtain the point cloud data to be encoded;
[0012] For the fourth node to be encoded in the point cloud data, determine the node information of the already encoded fifth node related to the fourth node;
[0013] Based on the coded node information of the fifth node, determine whether to enter the isolated point mode judgment for the fourth node;
[0014] If, based on the encoded node information of the fifth node, it is determined that the isolated point mode for the fourth node will not be entered, then the isolated point mode determination for the fourth node is skipped.
[0015] According to a third aspect of the embodiments of this application, a point cloud data processing apparatus is provided, the apparatus comprising:
[0016] The first acquisition module is used to acquire the compressed bitstream of point cloud data;
[0017] The first determining module is used to determine the node information of the decoded second node associated with the first node to be decoded in the compressed bitstream.
[0018] The first determination module is used to determine whether to enter the isolated point mode determination for the first node based on the node information of the decoded second node.
[0019] The first skip module is used to skip the isolated point mode determination for the first node if it is determined, based on the node information of the decoded second node, that the isolated point mode determination for the first node should not be entered.
[0020] According to a fourth aspect of the embodiments of this application, a point cloud data processing apparatus is also provided, the apparatus comprising:
[0021] The second acquisition module is used to acquire point cloud data to be encoded;
[0022] The second determining module is used to determine the node information of the already encoded fifth node related to the fourth node in the point cloud data for the fourth node to be encoded.
[0023] The second determination module is used to determine whether to enter the isolated point mode determination for the fourth node based on the node information of the encoded fifth node.
[0024] The second skip module is used to skip the isolation point mode determination for the fourth node if it is determined, based on the node information of the encoded fifth node, that the isolation point mode for the fourth node should not be entered.
[0025] According to a fifth aspect of the present application, an electronic device is provided, the electronic device including a memory, a processor and a computer program stored in the memory, the processor executing the computer program to implement the point cloud data processing method provided in the first aspect of the present application.
[0026] According to a sixth aspect of the embodiments of this application, an electronic device is also provided, the electronic device including a memory, a processor and a computer program stored in the memory, the processor executing the computer program to implement the point cloud data processing method provided in the second aspect of the embodiments of this application.
[0027] According to a seventh aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored, wherein when the computer program is executed by a processor, it implements the point cloud data processing method provided in the first aspect of the present application.
[0028] According to an eighth aspect of the embodiments of this application, a computer-readable storage medium is also provided, on which a computer program is stored, wherein when the computer program is executed by a processor, it implements the point cloud data processing method provided in the second aspect of the embodiments of this application.
[0029] According to a ninth aspect of the present application, a computer program product is provided, including a computer program that, when executed by a processor, implements the point cloud data processing method provided in the first aspect of the present application.
[0030] According to a tenth aspect of the embodiments of this application, a computer program product is also provided, including a computer program that, when executed by a processor, implements the point cloud data processing method provided in the second aspect of the embodiments of this application.
[0031] The point cloud data processing method, apparatus, electronic device, and storage medium provided in this application embodiment can acquire the compressed bitstream of point cloud data during the decoding stage; for a first node to be decoded in the compressed bitstream, determine the node information of a previously decoded second node related to the first node; based on the node information of the previously decoded second node, determine whether to enter the isolated point mode determination for the first node; if based on the node information of the previously decoded second node, it is determined not to enter the isolated point mode determination for the first node, then the isolated point mode determination for the first node is skipped. That is, in this application embodiment, for the first node to be decoded, the node information during spatial partitioning is fully considered to determine whether the isolated point mode determination process for the first node can be directly skipped, thereby improving the encoding efficiency of point cloud data. Attached Figure Description
[0032] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments of this application will be briefly introduced below.
[0033] Figure 1a A schematic diagram of an encoding framework provided in an embodiment of this application;
[0034] Figure 1b A schematic diagram of another encoding framework provided in an embodiment of this application;
[0035] Figure 2 A schematic diagram of the architecture of a point cloud data processing system provided in this application embodiment;
[0036] Figure 3A flowchart illustrating a point cloud data processing method provided in an embodiment of this application;
[0037] Figure 4a A schematic diagram of an octree encoding provided in an embodiment of this application;
[0038] Figure 4b A schematic diagram illustrating another octree encoding provided in an embodiment of this application;
[0039] Figure 5 A schematic diagram of a bounding box provided for an embodiment of this application;
[0040] Figure 6 A schematic diagram of a block structure encoding provided in an embodiment of this application;
[0041] Figure 7 A flowchart illustrating another point cloud data processing method provided in an embodiment of this application;
[0042] Figure 8 This is a schematic diagram of the structure of a point cloud data processing device provided in an embodiment of this application;
[0043] Figure 9 A schematic diagram of another point cloud data processing device provided in an embodiment of this application;
[0044] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0045] The embodiments of this application are described below with reference to the accompanying drawings. It should be understood that the embodiments described below with reference to the accompanying drawings are exemplary descriptions for explaining the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions of the embodiments of this application.
[0046] Those skilled in the art will understand that, unless otherwise stated, the singular forms “a,” “an,” and “the” used herein may also include the plural forms. It should be further understood that the terms “comprising” and “including” as used in embodiments of this application mean that the corresponding feature can be implemented as the presented feature, information, data, step, operation, element, and / or component, but do not exclude implementation as other features, information, data, step, operation, element, component, and / or combinations thereof supported by the art. It should be understood that when we say that an element is “connected” or “coupled” to another element, the one element can be directly connected or coupled to the other element, or it can mean that the one element and the other element establish a connection relationship through an intermediate element. Furthermore, “connected” or “coupled” as used herein can include wireless connection or wireless coupling. The term “and / or” as used herein indicates at least one of the items defined by the term; for example, “A and / or B” can be implemented as “A,” or as “B,” or as “A and B.”
[0047] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.
[0048] First, let's introduce and explain several terms used in this application:
[0049] (1) Point Cloud: A point cloud is a set of discrete points in three-dimensional space that are randomly distributed and represent the spatial structure and surface properties of a three-dimensional object or scene. Point clouds can be classified in different ways. For example, based on the data acquisition method, they can be divided into dense point clouds and sparse point clouds; based on the temporal type of the data, they can be divided into static point clouds and dynamic point clouds.
[0050] (2) Point Cloud Data: The geometric and attribute information of each point in the point cloud together constitutes the data.
[0051] (3) Geometric information: also known as three-dimensional position information. The geometric information of a point in a point cloud refers to the spatial coordinates (x, y, z) of that point, which can include the coordinate values of that point in each coordinate axis direction in three-dimensional space.
[0052] (4) Attribute information: The attribute information of a point in a point cloud may include, but is not limited to, at least one of the following: color information, material information, and laser reflection intensity information (also known as reflectivity). Typically, each point in a point cloud has the same number of attribute information.
[0053] (5) Point Cloud Compression (PCC): Point cloud compression refers to the process of encoding the geometric and attribute information of each point in a point cloud to obtain a compressed bitstream. Point cloud compression can include two main processes: geometric information encoding and attribute information encoding.
[0054] (6) Point cloud decoding: Point cloud decoding refers to the process of decoding the compressed bitstream obtained by point cloud encoding in order to reconstruct the point cloud; more specifically, it refers to the process of reconstructing the geometric information and attribute information of each point in the point cloud based on the geometric bitstream and attribute bitstream in the compressed bitstream.
[0055] Modern mainstream point cloud coding technologies can be divided into geometry-based point cloud coding and projection-based point cloud coding, depending on the type of point cloud. This section will use G-PCC (Geometry-Based Point Cloud Compression) from MPEG (Moving Picture Experts Group, an international audio / video coding standard) and AVS-PCC (Audio Video Coding Standard, China's national video coding standard) as examples for introduction.
[0056] Both G-PCC and AVS-PCC are designed for static sparse point clouds, and their encoding frameworks are largely the same, such as... Figure 1a The AVS-PCC encoding framework is shown, such as Figure 1b The coding framework of G-PCC is shown, which is divided into geometric information coding and attribute information coding.
[0057] The main operations and processing involved in encoding geometric information can be described as follows:
[0058] 1. Pre-processing: This includes coordinate transformation and voxelization. Point cloud data in 3D space can be converted into integer form through scaling and translation operations, and its smallest geometric position can be moved to the origin.
[0059] 2. Geometric Coding: Geometric coding mainly includes two modes: octree-based geometric coding and triangulation-based geometric coding. These two coding modes can be used under different conditions. Among them:
[0060] (a) Octree-based geometric encoding: An octree is a tree-like data structure that, in 3D spatial partitioning, uniformly divides a predefined bounding box, with each node having eight child nodes. By using "1" and "0" to indicate whether each child node of the octree is occupied, the occupancy code is obtained as the bitstream of the point cloud geometric information.
[0061] (b) Geometric encoding based on triangulation: The point cloud is divided into blocks of a certain size, and the intersection points of the point cloud surface with the edges of the blocks are located and triangles are constructed. Geometric information is compressed by encoding the intersection points.
[0062] 3. Geometry Quantization: The fineness of quantization is typically determined by the quantization parameter (QP). A larger QP value means that coefficients with a wider range of values will be quantized into the same output, which usually leads to greater distortion and a lower bit rate. Conversely, a smaller QP value means that coefficients with a smaller range of values will be quantized into the same output, which usually leads to less distortion and a higher bit rate. In point cloud encoding, quantization is performed directly on the coordinate information of the points.
[0063] 4. Geometric Entropy Encoding: This method uses statistical compression encoding on the occupancy code information of an octree to output a binary (0 or 1) compressed bitstream. Statistical coding is a lossless coding method that can effectively reduce the bit rate required to represent the same signal. A commonly used statistical coding method is Content Adaptive Binary Arithmetic Coding (CABAC).
[0064] The main operations and processing involved in encoding attribute information can be found in the following description:
[0065] 1. Attribute Recoloring: In lossy encoding, after the geometric information is encoded, the encoding device needs to decode and reconstruct the geometric information, that is, restore the coordinate information of each point in the 3D point cloud. The attribute information of one or more neighboring points in the original point cloud is used as the attribute information of the reconstructed point.
[0066] 2. Attribute Transform Coding: Attribute transform coding can include four modes: prediction, transform, prediction-transform, and (d) transform-prediction. These four coding modes can be used under different conditions. Among them:
[0067] (a) Prediction: Based on information such as distance or spatial relationships, the neighboring points of the point to be coded are determined as prediction points among the coded points, and the predicted value of the point is calculated according to the set criteria. The difference between the current point attribute value and the predicted value is calculated as attribute residual information, and the attribute residual information is quantized, transformed (optional), and entropy encoded.
[0068] (b) Transformation: Using transformation methods such as DCT (Discrete Cosine Transform) and Haar (a type of orthogonal normalization transformation), the attribute information is grouped and transformed, and the transformation coefficients are quantized; through inverse quantization, the attribute reconstruction value is obtained after inverse transformation; the difference between the original attribute and the attribute reconstruction value is calculated to obtain the attribute residual information and quantized; the quantized transformation coefficients and attribute residual information are encoded.
[0069] (c) Predictive transformation: Transform the residual signal obtained from the prediction.
[0070] (d) Transformation prediction: Predict the transformed parameter information.
[0071] 3. Attribute Quantization: The fineness of quantization is usually determined by the quantization parameter (QP). In predicting transform and lifting transform coding, entropy encoding is performed on the quantized residual values; in region adaptive hierarchical transform (RAHT) coding, entropy encoding is performed on the quantized transform coefficients.
[0072] 4. Attribute Entropy Coding: The quantized attribute residual signal or transform coefficients are generally compressed using run-length coding and arithmetic coding. The corresponding coding mode, quantization parameters, and other information are also encoded using an entropy encoder.
[0073] It is understandable that the decoding process is the inverse of the encoding process; that is, the geometric bitstream decoding process is the inverse of the geometric information encoding process described above, and the attribute bitstream decoding process is the inverse of the attribute information encoding process described above.
[0074] Specifically, according to the above encoding process, after obtaining the compressed bitstream, the decoding device first performs entropy decoding to obtain various mode information, quantized geometric information, and attribute information. On one hand, the geometric information is dequantized to obtain the reconstructed 3D point position information. On the other hand, the attribute information is dequantized to obtain residual information or transform coefficients, thereby confirming the reference signal based on the adopted transform mode, obtaining the reconstructed attribute information, and corresponding it one-to-one with the reconstructed geometric information in sequence to output the reconstructed point cloud data.
[0075] Based on the above introduction of basic concepts and technologies, this application provides an encoding optimization for isolated point patterns. For the case of encoding geometric information based on partitioning trees (partitioning trees may include, but are not limited to, octrees, quadtrees, binary trees, and other spatial partitioning geometric structures), the determination of geometric patterns is optimized by combining node information in the partitioning process of octrees, etc., thereby improving the encoding efficiency of geometric information.
[0076] The technical solutions of this application and their effects are described below through several exemplary embodiments. It should be noted that the following embodiments can be referenced, borrowed from, or combined with each other. Identical terms, similar features, and similar implementation steps in different embodiments will not be repeated.
[0077] First, combined Figure 2 A point cloud data processing system suitable for implementing the point cloud data processing method provided in the embodiments of this application is described. For example... Figure 2 As shown, the point cloud data processing system 20 may include an encoding device 201 and a decoding device 202. The encoding device 201 can be a terminal or a server, and the decoding device 202 can also be a terminal or a server. A communication connection can be established between the encoding device 201 and the decoding device 202. The terminal device can be a smartphone, tablet, laptop, desktop computer, smart wearable device (e.g., watch, glasses), smart TV, smart speaker, vehicle terminal, personal digital assistant, portable multimedia player, navigation device, etc., but is not limited to these. The server can be an independent physical server, a server cluster composed of multiple physical servers, or a distributed system. It can also be a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. For ease of explanation, this application embodiment does not distinguish between encoding devices and encoding ends; similarly, it does not distinguish between decoding devices and decoding ends.
[0078] (1) For encoding device 201:
[0079] Encoding device 201 can acquire point cloud data (i.e., the geometric and attribute information of each point in the point cloud). Point cloud data can be acquired through scene capture or device generation. Scene capture point cloud data refers to acquiring point cloud data from a real-world visual scene through a capture device associated with encoding device 201. The capture device provides point cloud data acquisition services for encoding device 201 and can include, but is not limited to, any of the following: camera equipment, sensing equipment, and scanning equipment. Camera equipment can include ordinary cameras, stereo cameras, and light field cameras, etc. Sensing equipment can include laser equipment, radar equipment, etc., and scanning equipment can include 3D laser scanning equipment, etc. The capture device associated with encoding device 201 can refer to a hardware component installed in encoding device 201, such as a camera or sensor on a terminal. Alternatively, the capture device associated with encoding device 201 can refer to a hardware device connected to encoding device 201, such as a camera connected to a server. Device-generated point cloud data refers to point cloud data generated by encoding device 201 based on virtual objects (e.g., virtual 3D objects and virtual 3D scenes obtained through 3D modeling).
[0080] After generating point cloud data, the encoding device 201 can encode the point cloud data to obtain bitstream data. Specifically, during the encoding process, the encoding device 201 can adopt the technical solution provided in the embodiments of this application. After obtaining the compressed bitstream of the point cloud data, the encoding device 201 transmits the bitstream data to the decoding device 202.
[0081] (2) For decoding device 202:
[0082] After receiving the compressed bitstream transmitted by the encoding device 201, the decoding device 202 can decode the compressed bitstream and present point cloud data based on the decoding result. Specifically, the decoding device 202 can adopt the technical solutions provided in the embodiments of this application during the decoding process.
[0083] It is understood that the point cloud data processing system described in the embodiments of this application is for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and does not constitute a limitation on the technical solutions provided in the embodiments of this application. Those skilled in the art should understand that with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.
[0084] Based on the description of the point cloud data processing system, the point cloud data processing method provided in the embodiments of this application will be described in more detail below.
[0085] Please see Figure 3This application provides a point cloud data processing method, which can be executed by a computer device. Specifically, the computer device can be... Figure 2 The decoding device 202 in the point cloud data processing system 20 shown. For example... Figure 3 As shown, the method includes:
[0086] Step S301: Obtain the compressed bitstream of the point cloud data;
[0087] As described above, after encoding the point cloud data, the encoding device obtains a corresponding compressed bitstream, which is then sent to the decoding device for processing. The compressed bitstream includes a geometric bitstream and an attribute bitstream. Correspondingly, upon receiving the compressed bitstream of the point cloud data, the decoding device can decode it.
[0088] Step S302: For the first node to be decoded in the compressed bitstream, determine the node information of the decoded second node related to the first node;
[0089] In the embodiments of this application, the first node can refer to any node in the point cloud that has not yet been decoded. The second node refers to a node in the point cloud that is related to the first node and has already been decoded. The node information of the second node refers to the information used in the decoding process of the node, such as whether the second node adopts a geometric pattern, the adopted geometric pattern, point cloud number information, space occupation information, bounding box information, neighborhood information, etc., but is not limited to these.
[0090] Among them, geometric patterns, also known as geometric coding patterns, include various patterns. For example, when encoding geometric information based on partitioning trees (such as octrees and other spatially partitioned geometric structures), these patterns may include, but are not limited to, isolated point patterns (also known as isolated point coding patterns) and planar patterns (also known as planar coding patterns). For ease of explanation, the following text will use the encoding of geometric information based on octrees as an example.
[0091] An octree is a tree-like data structure, currently primarily used in G-PCC or AVS-PCC for partitioning point clouds. For point cloud data in 3D space, the octree partitioning method uniformly divides a pre-defined bounding box layer by layer, with each node having eight child nodes, such as... Figure 4a As shown. Assume its placeholder code can be arranged as follows: Figure 4a The sequential encoding shown starts from position 0 and proceeds sequentially to position 7. It's understandable that other encoding orders can be designed as needed in practical applications; this is not a limitation here. The occupancy status of each child node in the octagon can be indicated using '1' and '0', such as... Figure 4bAs shown, assuming that the child nodes at positions 0 and 7 are occupied in the nodes corresponding to the cube, their corresponding placeholder codes can be 10000001. The child nodes at positions 0 and 7 can be divided into 8 smaller child nodes. Thus, based on the occupancy status of each child node, the placeholder codes corresponding to the child nodes at positions 0 and 7 are 00011000 (positions 3 and 4 are occupied) and 10001000 (positions 0 and 4 are occupied), respectively. The occupancy code information is obtained as the bitstream of the point cloud geometric information.
[0092] Optionally, an octree can be constructed based on Morton's order, that is, the 3D coordinate information of the point cloud data is converted into the corresponding Morton code by querying the Morton order table. Based on the order of each Morton code, the corresponding point of each level of the octree is obtained. Currently, the mainstream point cloud encoding technology uses octree partitioning to represent point cloud data, employing different processing procedures for geometric and attribute information.
[0093] The aforementioned bounding box is an algorithm for finding the optimal bounding space of a discrete point set. Its basic idea is to approximate a complex geometric object with a slightly larger and simpler geometric shape (such as a minimum cuboid), containing all points in the input point cloud data. This geometric shape can be called a bounding box. An exemplary bounding box for enclosing a geometric object can be as follows: Figure 5 As shown. The bounding box occupies a complete geometric area within three-dimensional space.
[0094] Step S303: Based on the decoded node information of the second node, determine whether to enter the isolated point mode judgment for the first node.
[0095] During multi-way tree geometric coding, the outlier coding mode may take effect when the current block simultaneously meets the following three conditions:
[0096] 1. The isolated point encoding pattern identifier in the geometric header information is 1;
[0097] 2. The isolated point encoding identifier of the level corresponding to the block to be encoded is true;
[0098] During octree partitioning, SinglePointEligibleFlagDepth[k] (an isolated point encoding identifier) is used to indicate whether the K level of the octree is enabled or satisfies the isolated point encoding mode. Different K levels correspond to different levels. The isolated point encoding mode of the corresponding level only takes effect when the above identifier is true. When the number of point clouds in the current level of the octree divided by the number of nodes in the current level is less than a certain threshold (M), the isolated point mode of the current level is true, that is, when SinglePointEligibleFlagDepth[k] = 1, the current octree level satisfies the isolated point encoding mode. This parameter needs to be passed to the decoding device, and the level determination threshold M can be set to 50.
[0099] In addition, an enabling parameter, gbh.OctreelevelDcmEligibleEnable, is introduced to determine whether to use the isolated point encoding mode based on the density of the point cloud. When the point cloud is determined to be a dense point cloud, the isolated point direct encoding mode is not used. For example, the hierarchical isolated point density determination is only enabled when the slice volume density is greater than 430,000.
[0100] 3. The current block contains only one point cloud data point.
[0101] When all three conditions above are met, the outlier encoding mode is determined. A flag is introduced to indicate whether the current node uses the outlier encoding mode. This flag uses a context for entropy encoding. If the flag is True, the outlier mode is adopted, the geometric coordinates of the point are directly encoded, and the octree partitioning ends. If the flag is False, the occupancy code is encoded, and the octree partitioning continues.
[0102] After encoding the flag, since the current block contains only one point cloud data point, the unencoded bits of the Morton code corresponding to the geometric coordinates of that point cloud data point are directly encoded. Specifically, the encoding is performed sequentially in the order of x, y, z, with directions that have already reached the minimum side length not needing to be encoded.
[0103] In octree encoding, it's necessary to limit the number of nodes with `singlePointFlag` set to 0 to improve encoding efficiency. Two modes are designed: mode0 and mode1. In mode0, nodes identified through outlier prior information are encoded normally, just like in the original scheme, except the number of nodes with `singlePointFlag` set to 1 needs to be recorded. In mode1, only nodes identified through outlier prior information are encoded. After encoding in one mode is complete, the encoding result determines which mode the next node will enter.
[0104] In mode 0, n1 nodes identified through prior information about isolated points are grouped together. Their encoding method is the same as the original scheme, only requiring the recording of the number of nodes with singlePointFlag set to 1 among these n1 nodes. If the number of nodes with singlePointFlag set to 1 is greater than or equal to a threshold, the next node continues to enter mode 0; otherwise, it enters mode 1.
[0105] In mode 1, n2 nodes identified through prior information about isolated points are grouped together. Nodes 1 to n2-1 undergo octree encoding, and their encoding results are recorded. If the number of nodes with only one occupied child node in the octree encoding results of these n2-1 nodes is greater than or equal to a threshold s, then the n2nd node will undergo normal isolated point encoding; otherwise, the n2nd node will also directly undergo octree encoding. If the n2nd node directly undergoes octree encoding, the next node continues into mode 1; otherwise, the mode selection for the next node is determined by the singelPointFlag decision of the n2nd node. If the n2nd node's decision result is 1, the next node will switch to mode 0; otherwise, the next node continues into mode 1.
[0106] The above isolated point encoding methods do not fully consider the geometric and neighborhood information during spatial partitioning. In the embodiments of this application, the determination of whether to enter the isolated point mode for the first node is based on the node information of the previously decoded second node.
[0107] Step S304: If, based on the node information of the decoded second node, it is determined that the isolated point mode determination for the first node should not be entered, then the isolated point mode determination for the first node is skipped.
[0108] In this embodiment of the application, for some specific cases, the isolated point mode determination for the first node can be skipped, that is, the flag identification bit determination and encoding can be skipped, thereby improving the encoding efficiency of point cloud geometric information and saving the bits for encoding the flag.
[0109] As an example, in a specific case, if the parent block of the current block already allows the use of the isolated point encoding mode, and the current block is the only child node of the parent block, then the current block must not contain any isolated points, and the aforementioned flag may be inferred to be False. In the embodiments of this application, the isolated point mode determination can be skipped directly for such child nodes.
[0110] It is understandable that there can be multiple types of decoded second nodes associated with the first node. From a spatial structure perspective, a decoded second node associated with the first node can include, but is limited to, at least one of the following:
[0111] (1) The decoded parent node of the first node;
[0112] In this embodiment, the position of the first node within its parent node is not limited. For example, assuming the above... Figure 4a The node shown is the parent node of the first node, so the first node can be located at any position from position 0 to position 7.
[0113] (2) The decoded neighbor nodes of the first node;
[0114] The neighbor nodes in this application embodiment include, but are not limited to: coplanar nodes (one of the six faces of a node is the same), collinear nodes (at least one of the twelve lines of a node is the same), concurrent nodes (at least one of the eight vertices of a node is the same), the nearest (decoded) node in a fixed direction on the same layer, and the (decoded) child nodes of adjacent nodes on the same layer, etc.
[0115] (3) The decoded grandparent node of the parent node;
[0116] Similarly, in the embodiments of this application, the position of the parent node of the first node in its parent node (the grandparent node of the first node) is not limited.
[0117] (4) The parent node's decoded neighbor nodes;
[0118] Similarly, this includes, but is not limited to: coplanar nodes of the parent node, collinear nodes of the parent node, common nodes of the parent node, the nearest (decoded) node in a fixed direction on the same layer of the parent node, and (decoded) child nodes of adjacent nodes on the same layer of the parent node.
[0119] (5) The decoded predecessor node of the first node.
[0120] The predecessor node of the first node is the decoded node that precedes the first node in the decoding order.
[0121] In this embodiment of the application, node information of at least one of the above-mentioned related nodes that have been decoded can be obtained. Using the decoded node information as reference information, it is determined whether the first node has entered the isolated point encoding mode determination. For example, if it is determined that the current node is likely not an isolated point, the isolated point encoding mode determination and the corresponding flag bit parsing are skipped.
[0122] In this embodiment of the application, an optional implementation method is provided for step S303. Specifically, it may include: determining whether to enter the isolated point mode determination for the first node based on the geometric pattern information of the decoded second node.
[0123] In this embodiment, geometric pattern information such as planar pattern is used as reference information. That is, based on the specific geometric pattern and position of the second node, it is determined whether to skip the isolated point pattern determination for the first node. As an example, if a large number of the preceding nodes of the first node adopt the planar pattern, the isolated point pattern determination for the first node can be skipped, and the planar encoding pattern can be directly adopted.
[0124] In one optional implementation, if the second node is at least one of the decoded parent node of the first node and the decoded grandparent node of the parent node, the node (statistical) information of the second node includes at least one of the following: the number of point cloud points contained in the second node, the number of occupied nodes of the second node, the distribution of occupied nodes of the second node, and the node side length of the second node.
[0125] Specifically, step S303 may include at least one of the following methods:
[0126] (1) Based on the relationship between the number of point cloud points contained in the second node and the first threshold, determine whether to enter the isolated point mode judgment for the first node.
[0127] As an example, if the number of point cloud points contained in the second node is greater than the first threshold, it is determined that the isolated point mode judgment for the first node will not be entered. In practical applications, the relationship between the number of point cloud points contained in the second node and the first threshold is not limited to "greater than", but can also be other relationships.
[0128] The first threshold corresponding to the parent node and the first threshold corresponding to the grandparent node can be the same or different. Those skilled in the art can set the value of the first threshold M3 according to the actual situation. This application embodiment does not limit this.
[0129] (2) Based on the relationship between the number of occupied nodes of the second node and the second threshold, determine whether to enter the isolated point mode judgment for the first node.
[0130] As an example, if the number of nodes occupied by the second node is greater than the second threshold, it is determined that the isolated node mode judgment for the first node will not be entered. In practical applications, the relationship between the number of nodes occupied by the second node and the second threshold is not limited to "greater than", but can also be other relationships.
[0131] The second threshold corresponding to the parent node and the second threshold corresponding to the grandparent node can be the same or different. Those skilled in the art can set the value of the second threshold M4 according to the actual situation. This application embodiment does not limit this.
[0132] (3) Based on the distribution of occupied nodes in the specified direction and the second node, determine whether to enter the isolated point mode judgment for at least two first nodes in the specified direction.
[0133] As an example, based on the occupied node distribution of the specified direction and the second node, determine the number of nodes in two layers (such as the two layers shown in Figure 4b ) in the specified direction. For the layer with a larger number of nodes among the two layers, determine not to enter the outlier mode determination for the first node of this layer;
[0134] In one example, taking the specified direction as the z - direction for example, the number of nodes s1 in the upper layer and the number of nodes s2 in the lower layer in this direction can be compared.
[0135] Optionally, if s1 < s2, the lower - layer nodes do not enter the outlier determination; vice versa. For example, if the occupancy code of the parent node is 0x01110100, referring to Figure 4a , then the number of nodes in the upper layer in the z - direction is 3 (positions 1, 3, 5), and the number of nodes in the lower layer is 1 (position 2), and it is determined that the upper - layer nodes do not enter the outlier mode determination;
[0136] Again as an example, based on the occupied node distribution of the specified direction and the second node, determine the number of nodes in two layers (such as the two layers shown in Figure 4b ) in the specified direction. For the layer where all nodes in the two layers are occupied, determine not to enter the outlier mode determination for the first node of this layer;
[0137] In one example, taking the specified direction as the z - direction for example, the number of nodes in each layer in this direction can be counted.
[0138] Optionally, if the number of nodes s1 in the upper layer is 4, that is, fully occupied, then the nodes in this layer do not enter the outlier mode determination. Similarly, if the number of nodes s1 in the lower layer is 4, then the nodes in this layer do not enter the outlier determination (both can also exist simultaneously).
[0139] (4) Based on the relationship between the ratio of the maximum side length to the minimum side length of the bounding box of the second node and the third threshold, determine whether to enter the outlier mode determination for the first node.
[0140] As an example, if the ratio of the maximum side length to the minimum side length of the bounding box of the second node is less than the third threshold, determine not to enter the outlier mode determination for the first node. In practical applications, the relationship between the ratio of the maximum side length to the minimum side length of the bounding box of the second node and the third threshold is not limited to "less than", and can also be other relationships.
[0141] Assume that the floating - point - type coordinate representation of point p in the input point cloud is (x p , y p , z p ), p = 0,..., P - 1, where P is the number of points in the point cloud, and the coordinate points (x min , y min , z min ) and (x maxy max , z max The following is represented:
[0142] x min =min(x 0 x 1 , ..., x P-1 )
[0143] y min =min(y 0 y 1 , ..., y P-1 )
[0144] z min =min(z) 0 , z 1 , ..., z P-1 )
[0145] x max =max(x 0 x 1 , ..., x P-1 )
[0146] y max =max(y 0 y 1 , ..., y P-1 )
[0147] z max =max(z) 0 , z 1 , ..., z P-1 )
[0148] function min(s) 0 s 1 , ..., s P-1 ) and max(s 0 s 1 , ..., s P-1 ) represent taking the minimum and maximum values of the current input, respectively.
[0149] Then the origin of the bounding box (x origin y origin , z origin It can be calculated as follows:
[0150] x origin =int(floor(x) min ))
[0151] y origin =int(floor(y) min ))
[0152] z origin =int(floor(z) min ))
[0153] The dimensions of the bounding box in the x, y, and z directions can be calculated as follows:
[0154] BoudingBoxSize x =int(x max -x origin )+1
[0155] BoudingBoxSize y =int(y max -y origin )+1
[0156] BoudingBoxSize z =int(z max -z origin )+1
[0157] Here, int(s) is the floor function, and floor(s) returns the largest integer value less than or equal to s.
[0158] Based on this, the maximum and minimum side lengths of the bounding box of the second node can be calculated, and then the ratio of the maximum to the minimum side length can be calculated and compared with the third threshold. The third threshold corresponding to the parent node and the third threshold corresponding to the grandparent node can be the same or different. Those skilled in the art can set the value of the third threshold N1 according to the actual situation, and this application embodiment does not impose any limitations on this.
[0159] (5) Based on the relationship between the index value of the first node in the parent node and the predetermined index value, determine whether to enter the isolated point mode judgment for the first node.
[0160] As an example, if the index value of the first node in the parent node is a predetermined index value, then it is determined that the isolation point mode determination for the first node will proceed. Alternatively, if the index value of the first node in the parent node is a predetermined index value, then it is determined that the isolation point mode determination for the first node will not proceed.
[0161] Those skilled in the art can set the value of the predetermined index value Idx according to the actual situation, and the embodiments of this application are not limited here.
[0162] Accordingly, if the index value of the first node in the parent node is not the predetermined index value, then it is determined that the isolation point mode determination for the first node will not be entered. If the index value of the first node in the parent node is not the predetermined index value, then it is determined that the isolation point mode determination for the first node will be entered.
[0163] In an optional implementation, if the second node is at least one of the decoded neighbor node of the first node and the decoded neighbor node of the parent node, then step S303 may specifically include at least one of the following methods:
[0164] (1) If the first node and the occupied second node are in the same direction, or the number of nodes of the occupied second node is greater than the fourth threshold, it is determined to enter the isolated point mode judgment for the first node, and the first node can adopt the isolated point encoding mode.
[0165] Otherwise, it is determined that the isolated point mode determination for the first node will not be entered, that is, the isolated point mode determination and encoding for the first node will be skipped.
[0166] (2) If the child node of the second node is occupied by the node adjacent to the first node, it is determined that the isolated point mode judgment for the first node will not be entered.
[0167] That is, if the neighboring node's child node adjacent to the first node is occupied, the isolated point pattern determination and encoding are skipped for the first node.
[0168] (3) If the child node of the second node is occupied and is not in isolated point mode, it is determined not to enter the isolated point mode judgment for the first node.
[0169] That is, if the neighboring node's child node adjacent to the first node is occupied and is not in isolated point mode (i.e., it has not entered the isolated point mode determination or has entered the isolated point mode but has not been determined as an isolated point), then the isolated point mode determination and encoding are skipped for the first node.
[0170] (4) Based on the relationship between the proportion of isolated points in the child nodes of the second node and the fifth threshold, determine whether to enter the isolated point mode judgment for the first node.
[0171] As an example, if the proportion of isolated points among the child nodes of the second node is less than the fifth threshold, it is determined that the isolated point mode judgment for the first node will not be entered. In practical applications, the relationship between the proportion of isolated points among the child nodes of the second node and the fifth threshold is not limited to "less than", but can also be other relationships.
[0172] That is, if the proportion of isolated points among the child nodes of a neighboring node is less than the fifth threshold N3, then the isolated point pattern determination and encoding for the first node are skipped. Those skilled in the art can set the value of the fifth threshold according to actual circumstances; this embodiment does not limit the specific settings.
[0173] (5) Based on the relationship between the isolated point in the second node that is closest to the first node and the distance to the first node and the sixth threshold, determine whether to enter the isolated point mode judgment for the first node.
[0174] As an example, if the distance between the second node and the first node that is closest to the first node (i.e., the second node that enters the isolated point mode determination and is determined to be an isolated point) is greater than the sixth threshold, it is determined that the isolated point mode determination for the first node will not be entered.
[0175] That is, if the distance between the nearest isolated point and the first node is greater than the sixth threshold S1, the first node skips the isolated point pattern determination and encoding. Those skilled in the art can set the value of the sixth threshold S1 according to actual conditions; this embodiment does not limit this setting, for example, it can be determined by relevant data such as the node side length. In practical applications, the relationship between this distance and the sixth threshold is not limited to "greater than," but can also be other relationships.
[0176] In one optional implementation, if the second node is the predecessor node of the first node, the node information of the second node includes at least one of the following:
[0177] (1) The number of empty nodes corresponding to the first predetermined number of non-empty predecessor nodes;
[0178] That is, the number of empty nodes N5 corresponding to the preceding N4 (a first predetermined number) non-empty nodes can be counted as reference information for determining whether to enter the isolated point mode for the first node. In practical applications, those skilled in the art can set the values of N4 and N5 according to the actual situation, and the embodiments of this application are not limited here.
[0179] (2) The number of nodes in the preceding nodes that adopt the isolated point pattern;
[0180] This means that the number of isolated point encoded nodes in the preceding nodes can be counted as reference information for determining whether to enter the isolated point mode judgment for the first node.
[0181] (3) The number of child nodes in the preceding node is the second predetermined number of nodes.
[0182] This means that the number of nodes whose child nodes occupy a value of M5 (a second predetermined number) in the preceding node can be counted as reference information for determining whether to enter the isolated node mode for the first node. In practical applications, those skilled in the art can set the value of M5 according to the actual situation, and this application embodiment does not limit it.
[0183] In one alternative implementation, the isolated point mode determination for the first node can be set at a fixed position. For example, a preset interval M5 can be set, and the isolated point mode determination for the first node can be performed every M5 points, while points other than these points skip the isolated point mode determination for the first node.
[0184] In this embodiment of the application, if the first node is the node corresponding to the preset interval, then the isolated point mode determination for the first node is entered.
[0185] Correspondingly, if the first node is not the node corresponding to the preset interval (i.e., the node between the preset interval points), the isolated point mode determination for the first node is skipped.
[0186] In this embodiment of the application, after entering the isolated point mode determination for the first node, or if it is determined that the first node adopts the isolated point mode, or if the isolated point mode determination for the first node is skipped and the first node is directly determined to adopt the isolated point mode, then after determining that the first node adopts the isolated point mode, the method may further include: determining a reference node based on at least one of the following methods, and resolving the geometric residual value based on the reference node. The geometric residual value is used to decode the first node, that is, using the nearest neighbor as a reference point to resolve the geometric residual value. The method of selecting the reference point includes, but is not limited to, at least one of the following:
[0187] (1) The node whose placeholder code in the octree is closest in sequence is 1;
[0188] (2) At least one of the bounding box information and level information of the first node, such as the geometric coordinates of the center point or vertex of the first node. The information of the center point or vertex can be obtained from the bounding box and level information. The level is the number of the current octree partition. For the specific determination method, please refer to the above introduction, which will not be repeated here.
[0189] (3) The nearest decoded isolated point in sequence;
[0190] (4) Decoded isolated points in the same layer.
[0191] Among them, a decoded isolated point refers to a node that has entered the isolated point mode judgment, been judged as an isolated point, and been decoded.
[0192] In this embodiment, isolated point pattern information can also be used to determine other geometric pattern encoding information. Optionally, for the determination of the planar pattern of the first node, the node in the second node that adopts the isolated point pattern is not used as the reference node.
[0193] In one alternative implementation, it is determined whether to enter a predetermined geometric pattern determination for the first node, and the node in the second node that adopts the isolated point pattern is not used as the reference node.
[0194] In this embodiment of the application, the second node adopts the isolated point mode, including but not limited to the second node entering the isolated point mode determination, or the second node being determined as an isolated point after entering the isolated point mode determination.
[0195] As an example, for the planar coding mode, nodes in the preceding nodes that are isolated point modes are not used as reference nodes for determining whether to enter the planar mode for the first node.
[0196] Specifically, for the processing of planar encoding mode, the `gsh_planar_mode` (slice geometry planar mode flag field) is added to the geometry slice header information parameter set to indicate whether planar encoding mode is enabled. When `gsh_planar_mode` is 1, planar encoding mode is enabled. When `gsh_planar_mode` is 0, planar encoding mode is disabled. For slices with a bounding box volume to pixel ratio in the range of 750 to 280,000, the encoding device performs the following operations:
[0197] 1. Determine the eligibility of the current node.
[0198] Select 5 coded neighbor nodes of the current node as reference nodes.
[0199] If the coordinates of the current node are (x, y, z), then the reference nodes are (x-1, y, z), (x-2, y, z), (x, y-1, z), (x, y-2, z), (x-1, y-1, z).
[0200] In an octree structure, each plane consists of four nodes. Along a specific axis, the lower plane is arranged first, followed by the higher plane. For example, along the X-axis, the first four nodes of a parent node in the YZ plane form the lower plane, while the next four nodes of the same parent node form the higher plane. This order of the lower and higher planes is also the encoding order. Furthermore, placeholders for a set of child nodes of an adjacent node at depth D+1 in the tree structure are used to determine the plane's positional context information.
[0201] If the number of nodes among the 5 reference nodes that satisfy either the condition that none of the lower plane child nodes are occupied or the condition that none of the higher plane child nodes are occupied is greater than 3, then continue with the following steps.
[0202] 2. Obtain the current node status based on the child node occupancy status of the reference node.
[0203] In the reference node, the number of child nodes located in the low plane is denoted as LowOccNum, and the number of child nodes located in the high plane is denoted as HighOccNum, where:
[0204] 1) When LowOccNum > 1 and HighOccNum < 1, the state is 0;
[0205] 2) If LowOccNum < 1 and HighOccNum > 1, then it is state 1;
[0206] 3) All others are in state 2.
[0207] 3. Set three contexts based on the current node's state and the positions of its child nodes:
[0208] 1) The current node is in state 0 and the child node to be encoded is located in the high plane of the current node;
[0209] 2) The current node is in state 1 and the child node to be encoded is located in the lower plane of the current node;
[0210] 3) All other cases.
[0211] When encoding the placeholder bits of each child node, a contextModel is allocated to each child node that satisfies the first and second cases; the child node that satisfies the third case is further subdivided using the context in the existing scheme. A total of 2 contextModels are added to the existing context.
[0212] In this embodiment, if the reference node with coordinates (x, y, z) of the current node includes a node using the isolated point mode, then that reference node is removed, or another reference node is selected. The advantage of this is that it avoids interference from nodes using the isolated point mode on the execution of the aforementioned planar mode, thus improving the accuracy of the planar mode determination.
[0213] In practical applications, the predetermined geometric pattern can be an isolated point pattern, a planar pattern, or other geometric patterns, and this application embodiment does not limit it.
[0214] In another optional implementation, if there is a node in the second node that adopts the isolated point pattern, the predetermined geometric pattern determination for the first node is not entered.
[0215] Similarly, in the embodiments of this application, the second node adopts the isolated point mode, including but not limited to the situation where the second node enters the isolated point mode determination, or the second node is determined to be an isolated point after entering the isolated point mode determination.
[0216] As an example, if there is an isolated point in the second node, or a node that may enter the isolated point mode, the current first node does not enter the planar mode.
[0217] In practical applications, the predetermined geometric pattern can be an isolated point pattern, a planar pattern, or other geometric patterns, which are not limited in this embodiment. If the predetermined geometric pattern is an isolated point pattern, this step can be performed before step S304, for example, in step S303. If the predetermined geometric pattern is a planar pattern or other patterns, this step can be performed after step S304. Those skilled in the art can configure the steps according to the actual situation. In this embodiment, after step S301, it can be determined whether the current point cloud uses geometric pattern encoding. Specifically, at least one of the following methods is used to determine whether the point cloud data uses a geometric pattern: point cloud data, fragmentation layer, macroblock layer, and octree layer.
[0218] Point cloud data can be divided into one or more slices, each slice consisting of a macroblock (Largest Coding Unit, LCU). A macroblock is a coding unit (the basic unit of coding processing). The block-structured coding method introduces a concept similar to coding blocks in video coding, dividing the three-dimensional space into several... Non-overlapping coded macroblocks of varying sizes are used, with each macroblock serving as a basic coding unit. The number of macroblocks is not limited. The size of the 3D macroblocks can be controlled by setting the octree partitioning depth *d* or by related parameters (such as *nodeSizeLog2*, the node size parameter). When the octree partitioning is such that each node is... And when the following conditions are met:
[0219] nodeSizeLog2>max(d x ,d y ,d z )
[0220] Each node is encoded according to a macroblock (LCU). Here, the partition depth represents the depth of the geometric partition, and the depth of the root node can be defined as 0. The depth value increases by 1 with each partition.
[0221] like Figure 6 As shown, in a 2D quadtree partitioning scenario, assuming encoding starts from the second level and proceeds sequentially according to macroblocks, each macroblock can be viewed as a separate tree partitioning structure. In the current implementation, each encoded macroblock can be traversed using breadth-first search. For example, within macroblock 1, the second level (node 1) is traversed first, then the third level (nodes 2 and 3), and finally the fourth level (nodes 4 and 5). This block-structure encoding method offers high flexibility. For instance, for each macroblock, different geometric encoding methods can be used based on its characteristics. Figure 6 Macroblock 1 shown uses a partition tree-based geometric coding method. Figure 6Macroblock 2 shown employs prediction tree-based geometric coding. This application does not limit the geometric coding method used for macroblocks. Furthermore, attribute coding can be performed after the geometric coding of a macroblock is completed, eliminating the need to wait for the entire point cloud to be geometrically coded before attribute coding can proceed, thus improving the flexibility of the coding method.
[0222] Specifically, determining whether point cloud data adopts a geometric pattern at the point cloud data or slicing layer can be achieved through at least one of the following methods:
[0223] (1) Whether to use the default mode;
[0224] The decoding and encoding devices can negotiate and set a default encoding mode. The default encoding mode is the encoding mode of the node to be decoded in the point cloud, and it is also the encoding mode shared by all nodes in the point cloud. This allows determining whether the current geometric pattern should use the default mode.
[0225] (2) Mode information parsed from parameter sets or compressed bitstreams;
[0226] The encoding parameter set or compressed bitstream of a point cloud can be parsed to obtain the encoding mode of the node to be decoded in the point cloud, and the encoding mode of the node to be decoded can be determined as the encoding mode information of the point cloud. When the encoding parameter set contains mode information, the decoding device can obtain the encoding mode information of the node to be decoded by parsing the encoding parameter set; when the encoding parameter set does not contain mode information, the geometric mode of the node to be decoded can be obtained by directly parsing the compressed bitstream.
[0227] (3) Corresponding mode information determined based on the default parameter information used;
[0228] The default parameter information can be determined through negotiation between the encoding and decoding devices.
[0229] (4) The corresponding mode information determined from the parameter information parsed from the parameter set or compressed bitstream.
[0230] The parameter information can be obtained by parsing from the encoding parameter set of the point cloud or the compressed bitstream.
[0231] For example, parameter information may include, but is not limited to: statistical characteristic information corresponding to the residual analysis information of the node to be decoded, side length ratio information corresponding to the bounding box, quantization parameters of the node to be decoded, etc., and comparison relationship with the corresponding threshold to determine the geometric pattern of the node to be decoded.
[0232] Specifically, determining whether a node entering octree encoding uses the geometric pattern encoding mode at the macroblock (LCU) level can be achieved through at least one of the following methods:
[0233] (1) Whether to adopt the default mode;
[0234] (2) The mode information parsed from the parameter set or the compressed bitstream;
[0235] (3) The corresponding mode information determined based on the adopted default parameter information;
[0236] (4) The corresponding mode information determined from the parameter information parsed from the parameter set or the compressed bitstream.
[0237] Among them, the parameter information includes at least one of the following: whether there are predicted tree neighbor nodes during macroblock partitioning; the density during macroblock partitioning. That is, the corresponding mode information determined based on the parameter information can be determined according to whether there are predicted tree neighbor nodes during LCU partitioning, or can be determined according to the density during LCU partitioning, etc.
[0238] For other unelaborated parts, reference can be made to the introduction in the above text on determining whether to adopt the geometric mode for point cloud data in the point cloud data or slice layer, which will not be elaborated here.
[0239] Specifically, when determining whether to use the geometric mode coding mode at the current octree level (depth), it can be through at least one of the following methods, but not limited to:
[0240] (1) Whether to adopt the default mode;
[0241] (2) The mode information parsed from the parameter set or the compressed bitstream;
[0242] (3) The corresponding mode information determined based on the adopted default parameter information;
[0243] (4) The corresponding mode information determined from the parameter information parsed from the parameter set or the compressed bitstream.
[0244] Among them, the parameter information includes at least one of the following: the bounding box information of the hierarchical node; the hierarchical threshold range; the number of hierarchical nodes; the number of hierarchical nodes determined based on the relationship between the number of point clouds contained and the third predetermined number (for example, the number of nodes in the hierarchical node where the number of point clouds contained is less than the third predetermined number, or the number of nodes in the hierarchical node where the number of point clouds contained is greater than the third predetermined number, etc.). That is, the corresponding mode information determined based on the parameter information can be according to at least one of the following methods:
[0245] 1) Determine according to the bounding box information (side length information, etc.) of the current layer node;
[0246] 2) Determine according to the hierarchical threshold range d1, d2 (which can be used simultaneously or separately), for example, when the current depth < d1 or depth > d2, do not enter the hierarchical isolated point mode determination;
[0247] 3) Determined according to the hierarchical threshold range d3, if the current depth > d3, all points are encoded in the outlier mode, and there is no need to transmit the singlePointFlag;
[0248] 4) According to the statistics of the number of nodes M6 in the current layer, the number of nodes M7 (as a possible outlier prediction value) with the number of point cloud points less than m contained therein; for example, if a × M6 + b × M7 < c × M7, the hierarchical outlier mode determination is enabled; if a × M6 + b × M7 ≥ c × M7, the hierarchical outlier mode determination is disabled. Where a, b, and c can be set, and the embodiments of the present application do not limit this here. For example, b can be set according to the side length information of the nodes in the current layer (nodeSizeLog2 - 1).
[0249] Based on at least one of the above embodiments, the embodiments of the present application provide a process example executed by a decoding device, as shown in the following steps. All steps can be used alone or in combination:
[0250] 1. Use at least one of the above embodiments to determine whether the current point cloud is encoded in the geometric mode
[0251] 2. Use at least one of the above embodiments, and use the decoded node information as reference information to determine whether the current node enters the outlier encoding mode determination
[0252] 3. Obtain singlePointInfer. If singlePointInfer = 1, the singlePointFlag is the default value and does not need to be encoded; if singlePointInfer = 0, encode the singlePointFlag;
[0253] 4. Encode the geometric position information of the outlier, including but not limited to the following methods:
[0254] 1) Directly encode the uncoded bits of the Morton code corresponding to the geometric coordinates of the point cloud point. Specifically, it can be encoded sequentially in the order of x, y, z, and the direction that has reached the minimum side length does not need to be encoded.
[0255] 2) Use at least one of the above methods to use the nearest neighbor point as a reference point to resolve the geometric residual value.
[0256] 5. For the plane encoding mode, do not use the nodes in the previous nodes that are in the outlier mode as reference nodes for the plane mode determination; if there are nodes in the second node that are in the outlier mode, do not enter the plane mode determination for the first node.
[0257] It should be noted that the above decoding process may also include steps such as inverse quantization and coordinate transformation. For details, please refer to the descriptions of existing technologies, which will not be repeated here.
[0258] The point cloud data processing method provided in this application makes full use of historical spatial occupancy information, neighborhood information and other nodes to improve the coding efficiency of point cloud geometric information and improve the accuracy of planar pattern determination.
[0259] Accordingly, embodiments of this application also provide a point cloud data processing method, which can be executed by a computer device, specifically a computer device that can be... Figure 2 The encoding device 201 in the point cloud data processing system 20 shown. For example... Figure 7 As shown, the method includes:
[0260] Step S701: Obtain the point cloud data to be encoded;
[0261] Step S702: For the fourth node to be encoded in the point cloud data, determine the node information of the already encoded fifth node related to the fourth node;
[0262] Step S703: Based on the node information of the encoded fifth node, determine whether to enter the isolated point mode judgment for the fourth node;
[0263] Step S704: If, based on the encoded node information of the fifth node, it is determined that the isolated point mode for the fourth node will not be entered, then the isolated point mode determination for the fourth node is skipped.
[0264] Optionally, the fifth node associated with the fourth node includes at least one of the following:
[0265] The encoded parent node of the fourth node;
[0266] The coded neighbor nodes of the fourth node;
[0267] The encoded grandparent node of the parent node;
[0268] The encoded neighbor nodes of the parent node;
[0269] The coded predecessor node of the fourth node.
[0270] Optionally, if the fifth node is at least one of the encoded parent node of the fourth node and the encoded neighbor node of the parent node, the node information of the fifth node includes at least one of the following: the number of point cloud points contained in the fifth node, the number of occupied nodes of the fifth node, the distribution of occupied nodes of the fifth node, and the node edge length of the fifth node; based on the encoded node information of the fifth node, determining whether to enter the isolated point mode judgment for the fourth node includes at least one of the following methods:
[0271] Based on the encoded node information of the fifth node, determine whether to enter the isolated point mode judgment for the fourth node, including at least one of the following methods:
[0272] Based on the relationship between the number of point cloud points contained in the fifth node and the first threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0273] Based on the relationship between the number of nodes occupied by the fifth node and the second threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0274] Based on the specified direction and the distribution of occupied nodes of the fifth node, determine whether to enter the isolated point mode judgment for at least two fourth nodes in the specified direction.
[0275] Based on the relationship between the ratio of the maximum to the minimum side length of the fifth node's bounding box and the third threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0276] Based on the relationship between the index value of the first node in the parent node and the predetermined index value, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0277] Optionally, if the fifth node is at least one of the encoded neighbor nodes of the fourth node and the encoded neighbor nodes of the parent node, based on the node information of the encoded fifth node, it is determined whether to enter the isolated point mode determination for the fourth node, including at least one of the following methods:
[0278] If the fourth node and the occupied fifth node are in the same direction, or the number of occupied fifth nodes is greater than the fourth threshold, then the isolated point mode judgment for the fourth node is determined; otherwise, the isolated point mode judgment for the fourth node is not determined.
[0279] If the child node of the fifth node that is adjacent to the fourth node is occupied, it is determined that the isolated point mode judgment for the fourth node will not be entered.
[0280] If the child node of the fifth node that is adjacent to the fourth node is occupied and is not in isolated point mode, then the isolated point mode determination for the fourth node will not be entered.
[0281] Based on the relationship between the proportion of isolated points in the child nodes of the fifth node and the fifth threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0282] Based on the relationship between the isolated point in the fifth node that is closest to the fourth node and the distance to the fourth node and the sixth threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0283] Optionally, if the fifth node is the predecessor node of the fourth node, the node information of the fifth node includes at least one of the following:
[0284] The number of empty nodes corresponding to the first predetermined number of non-empty predecessor nodes;
[0285] The number of nodes in the preceding nodes that use the isolated point pattern;
[0286] The number of child nodes in the preceding node is the second predetermined number of nodes.
[0287] Optionally, based on the node information of the encoded fifth node, a determination is made as to whether to enter the isolated point mode judgment for the fourth node, including:
[0288] Based on the encoded geometric pattern information of the fifth node, determine whether to proceed to the isolated point pattern determination for the fourth node.
[0289] Optionally, the method further includes:
[0290] If the fourth node is the node corresponding to the preset interval, then the isolated point mode judgment for the fourth node is entered.
[0291] Optionally, after determining that the fourth node adopts the isolated point mode, the following is also included:
[0292] The reference node is determined based on at least one of the following methods, and the geometric residual value is parsed based on the reference node. The geometric residual value is used to encode the fourth node:
[0293] The nearest octree node with a placeholder code of 1 in the sequence;
[0294] At least one of the bounding box information and hierarchy information of the fourth node;
[0295] The nearest coded outlier in sequence;
[0296] Isolated points already coded in the same layer.
[0297] Optionally, the method further includes at least one of the following:
[0298] Determine whether to enter the predetermined geometric mode judgment for the fourth node, and do not use the node in the second node that adopts the isolated point mode as the reference node;
[0299] If there is a node in the fifth node that adopts the isolated point pattern, the predetermined geometric pattern determination for the fourth node will not be performed.
[0300] Optionally, after obtaining the compressed bitstream of the point cloud data, the method further includes:
[0301] In at least one of the point cloud data, fragmentation layer, macroblock layer and octree level, determine whether the point cloud data adopts a geometric pattern by at least one of the following:
[0302] Should we use the default mode?
[0303] Pattern information parsed from parameter sets or compressed bitstreams;
[0304] The corresponding mode information is determined based on the default parameter information used;
[0305] The corresponding mode information is determined from the parameter information parsed from the parameter set or compressed bitstream.
[0306] Optionally, the parameter information includes at least one of the following:
[0307] Are there prediction tree neighbor nodes during macroblock partitioning?
[0308] Density during macroblock partitioning;
[0309] Bounding box information of hierarchical nodes;
[0310] Hierarchical threshold range;
[0311] The number of hierarchical nodes;
[0312] The number of hierarchical nodes is determined based on the relationship between the number of point cloud points and the third predetermined number.
[0313] It should be understood that the point cloud data encoding method is the reverse process of the point cloud data decoding method described above. The specific implementation methods for each step in the point cloud data encoding method can be found in the corresponding steps of the point cloud data decoding method; to avoid repetition, they will not be repeated here.
[0314] The point cloud data processing technology involved in this application can be implemented using cloud technology; for example, using a cloud server as a decoding or encoding device. Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and networks within a wide area network or local area network to realize the computation, storage, processing, and sharing of data.
[0315] The embodiments of this application can also be combined with cloud technologies such as cloud computing and cloud storage. Wherein:
[0316] Cloud computing is a computing model that distributes computing tasks across a resource pool consisting of a large number of computers, enabling various application systems to obtain computing power, storage space, and information services as needed. Cloud computing can provide powerful computing support for the point cloud encoding and decoding processes, which can greatly improve the geometric encoding and decoding efficiency of point clouds.
[0317] Cloud storage is a new concept that extends and develops from the concept of cloud computing. A distributed cloud storage system (hereinafter referred to as a storage system) refers to a storage system that uses cluster applications, grid technology, and distributed storage file systems to bring together a large number of storage devices of various types (storage devices are also called storage nodes) in the network to work together through application software or application interfaces to provide data storage and business access functions. Cloud storage can provide strong storage support for the point cloud encoding and decoding stages, thereby reducing the data storage pressure of point clouds in the encoding and decoding process and improving data processing efficiency.
[0318] This application provides a point cloud data processing device, such as... Figure 8 As shown, the point cloud data processing device 80 may include: a first acquisition module 801, a first determination module 802, a first judgment module 803, and a first skip module 804. Among them,
[0319] The first acquisition module 801 is used to acquire the compressed bitstream of point cloud data;
[0320] The first determining module 802 is used to determine the node information of the decoded second node associated with the first node to be decoded in the compressed bitstream.
[0321] The first determination module 803 is used to determine whether to enter the isolated point mode determination for the first node based on the node information of the decoded second node.
[0322] The first skip module 804 is used to skip the isolated point mode determination for the first node if it is determined, based on the node information of the decoded second node, that the isolated point mode determination for the first node should not be entered.
[0323] In one alternative implementation, the second node associated with the first node includes at least one of the following:
[0324] The decoded parent node of the first node;
[0325] The decoded neighbor nodes of the first node;
[0326] The decoded grandparent node of the parent node;
[0327] The decoded neighbor nodes of the parent node;
[0328] The decoded predecessor node of the first node.
[0329] In one optional implementation, when the first determination module 803 determines whether to enter the isolated point mode determination for the first node based on the node information of the decoded second node, it is specifically used for:
[0330] Based on the geometric pattern information of the decoded second node, determine whether to enter the isolated point mode judgment for the first node.
[0331] In one optional implementation, if the second node is at least one of the decoded parent node of the first node and the decoded grandparent node of the parent node, the node information of the second node includes at least one of the following: the number of point cloud points contained in the second node, the number of occupied nodes of the second node, the distribution of occupied nodes of the second node, and the node side length of the second node.
[0332] When the first determination module 803 determines whether to enter the isolated point mode determination for the first node based on the node information of the decoded second node, it is specifically used for:
[0333] Based on the relationship between the number of point cloud points contained in the second node and the first threshold, it is determined whether to enter the isolated point mode judgment for the first node.
[0334] Based on the relationship between the number of nodes occupied by the second node and the second threshold, it is determined whether to enter the isolated point mode judgment for the first node.
[0335] Based on the distribution of occupied nodes in the specified direction and the second node, determine whether to enter the isolated point mode judgment for at least two first nodes in the specified direction.
[0336] Based on the relationship between the ratio of the maximum to the minimum side length of the bounding box of the second node and the third threshold, it is determined whether to enter the isolated point mode judgment for the first node.
[0337] Based on the relationship between the index value of the first node in the parent node and the predetermined index value, it is determined whether to enter the isolated point mode judgment for the first node.
[0338] In one optional implementation, the second node is at least one of the decoded neighbor node of the first node and the decoded neighbor node of the parent node.
[0339] When the first determination module 803 determines whether to enter the isolated point mode determination for the first node based on the node information of the decoded second node, it is specifically used for:
[0340] If the first node and the occupied second node are in the same direction, or the number of nodes of the occupied second node is greater than the fourth threshold, it is determined to enter the isolated point mode judgment for the first node; otherwise, it is determined not to enter the isolated point mode judgment for the first node.
[0341] If the child node of the second node that is adjacent to the first node is occupied, it is determined that the isolated point mode judgment for the first node will not be entered.
[0342] If the child node of the second node that is adjacent to the first node is occupied and is not in isolated point mode, then the isolated point mode determination for the first node will not be entered.
[0343] Based on the relationship between the proportion of isolated points in the child nodes of the second node and the fifth threshold, it is determined whether to enter the isolated point mode judgment for the first node.
[0344] Based on the relationship between the isolated point in the second node that is closest to the first node and the distance to the first node and the sixth threshold, it is determined whether to enter the isolated point mode judgment for the first node.
[0345] In one optional implementation, if the second node is the predecessor node of the first node, the node information of the second node includes at least one of the following:
[0346] The number of empty nodes corresponding to the first predetermined number of non-empty predecessor nodes;
[0347] The number of nodes in the preceding nodes that use the isolated point pattern;
[0348] The number of child nodes in the preceding node is the second predetermined number of nodes.
[0349] In an optional implementation, the point cloud data processing device 80 further includes: a first input module 805, used for:
[0350] If the first node is the node corresponding to the preset interval, then the isolated point mode judgment for the first node is entered.
[0351] In an optional implementation, the point cloud data processing device 80 further includes: a decoding module 806, which, after the first entry module 805 determines that the first node adopts an isolated point mode, is used to:
[0352] The reference node is determined based on at least one of the following methods, and the geometric residual value is parsed based on the reference node. The geometric residual value is used to decode the first node:
[0353] The nearest octree node with a placeholder code of 1 in the sequence;
[0354] At least one of the bounding box information and hierarchy information of the first node;
[0355] The nearest decoded outlier in sequence;
[0356] Isolated point already decoded on the same layer.
[0357] In one optional implementation, the first determination module 803 is further configured to perform at least one of the following:
[0358] Determine whether to enter the predetermined geometric mode judgment for the first node, and do not use the node in the second node that adopts the isolated point mode as the reference node;
[0359] If there are nodes in the second node that adopt the isolated point pattern, the predetermined geometric pattern determination for the first node will not be performed.
[0360] In an optional implementation, after the first acquisition module 801 acquires the compressed bitstream of the point cloud data, the first determination module 802 is further configured to:
[0361] In at least one of the point cloud data, fragmentation layer, macroblock layer and octree level, determine whether the point cloud data adopts a geometric pattern by at least one of the following:
[0362] Should we use the default mode?
[0363] Pattern information parsed from parameter sets or compressed bitstreams;
[0364] The corresponding mode information is determined based on the default parameter information used;
[0365] The corresponding mode information is determined from the parameter information parsed from the parameter set or compressed bitstream.
[0366] In one optional implementation, the parameter information includes at least one of the following:
[0367] Are there prediction tree neighbor nodes during macroblock partitioning?
[0368] Density during macroblock partitioning;
[0369] Bounding box information of hierarchical nodes;
[0370] Hierarchical threshold range;
[0371] The number of hierarchical nodes;
[0372] The number of hierarchical nodes is determined based on the relationship between the number of point cloud points and the third predetermined number.
[0373] This application also provides a point cloud data processing device, such as... Figure 9 As shown, the point cloud data processing device 90 may include: a second acquisition module 901, a second determination module 902, a second judgment module 903, and a second skip module 904.
[0374] The second acquisition module 901 is used to acquire point cloud data to be encoded;
[0375] The second determining module 902 is used to determine the node information of the already encoded fifth node related to the fourth node in the point cloud data for the fourth node to be encoded.
[0376] The second determination module 903 is used to determine whether to enter the isolated point mode determination for the fourth node based on the node information of the encoded fifth node.
[0377] The second skip module 904 is used to skip the isolation point mode determination for the fourth node if it is determined, based on the node information of the encoded fifth node, that the isolation point mode for the fourth node should not be entered.
[0378] In one alternative implementation, the fifth node associated with the fourth node includes at least one of the following:
[0379] The encoded parent node of the fourth node;
[0380] The coded neighbor nodes of the fourth node;
[0381] The encoded grandparent node of the parent node;
[0382] The encoded neighbor nodes of the parent node;
[0383] The coded predecessor node of the fourth node.
[0384] In one optional implementation, when the second determination module 903 determines whether to enter the isolated point mode determination for the fourth node based on the encoded node information of the fifth node, it is specifically used for:
[0385] Based on the encoded geometric pattern information of the fifth node, determine whether to proceed to the isolated point pattern determination for the fourth node.
[0386] In one optional implementation, if the fifth node is at least one of the encoded parent node of the fourth node and the encoded neighbor node of the parent node, the node information of the fifth node includes at least one of the following: the number of point cloud points contained in the fifth node, the number of occupied nodes of the fifth node, the distribution of occupied nodes of the fifth node, and the node side length of the fifth node.
[0387] When the second determination module 903 determines whether to enter the isolated point mode determination for the fourth node based on the node information of the encoded fifth node, it is specifically used for at least one of the following:
[0388] Based on the encoded node information of the fifth node, determine whether to enter the isolated point mode judgment for the fourth node, including at least one of the following methods:
[0389] Based on the relationship between the number of point cloud points contained in the fifth node and the first threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0390] Based on the relationship between the number of nodes occupied by the fifth node and the second threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0391] Based on the specified direction and the distribution of occupied nodes of the fifth node, determine whether to enter the isolated point mode judgment for at least two fourth nodes in the specified direction.
[0392] Based on the relationship between the ratio of the maximum to the minimum side length of the fifth node's bounding box and the third threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0393] Based on the relationship between the index value of the first node in the parent node and the predetermined index value, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0394] In an optional implementation, if the fifth node is at least one of the encoded neighbor nodes of the fourth node and the encoded neighbor nodes of the parent node, the second determination module 903, when determining whether to enter the isolated point mode determination for the fourth node based on the node information of the encoded fifth node, is specifically used for:
[0395] If the fourth node and the occupied fifth node are in the same direction, or the number of occupied fifth nodes is greater than the fourth threshold, then the isolated point mode judgment for the fourth node is determined; otherwise, the isolated point mode judgment for the fourth node is not determined.
[0396] If the child node of the fifth node that is adjacent to the fourth node is occupied, it is determined that the isolated point mode judgment for the fourth node will not be entered.
[0397] If the child node of the fifth node that is adjacent to the fourth node is occupied and is not in isolated point mode, then the isolated point mode determination for the fourth node will not be entered.
[0398] Based on the relationship between the proportion of isolated points in the child nodes of the fifth node and the fifth threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0399] Based on the relationship between the isolated point in the fifth node that is closest to the fourth node and the distance to the fourth node and the sixth threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
[0400] In one optional implementation, if the fifth node is the predecessor node of the fourth node, the node information of the fifth node includes at least one of the following:
[0401] The number of empty nodes corresponding to the first predetermined number of non-empty predecessor nodes;
[0402] The number of nodes in the preceding nodes that use the isolated point pattern;
[0403] The number of child nodes in the preceding node is the second predetermined number of nodes.
[0404] In an optional embodiment, the point cloud data processing device 90 further includes: a second input module 905, used for:
[0405] If the fourth node is the node corresponding to the preset interval, then the isolated point mode judgment for the fourth node is entered.
[0406] In an optional implementation, the point cloud data processing device 90 further includes: an encoding module 906, which, after the second input module 905 determines that the fourth node adopts the isolated point mode, is used for:
[0407] The reference node is determined based on at least one of the following methods, and the geometric residual value is parsed based on the reference node. The geometric residual value is used to encode the fourth node:
[0408] The nearest octree node with a placeholder code of 1 in the sequence;
[0409] At least one of the bounding box information and hierarchy information of the fourth node;
[0410] The nearest coded outlier in sequence;
[0411] Isolated points already coded in the same layer.
[0412] In one optional implementation, the second determination module 903 is further configured to perform at least one of the following:
[0413] Determine whether to enter the predetermined geometric mode judgment for the fourth node, and do not use the node in the second node that adopts the isolated point mode as the reference node;
[0414] If there is a node in the fifth node that adopts the isolated point pattern, the predetermined geometric pattern determination for the fourth node will not be performed.
[0415] In an optional implementation, after the second acquisition module 901 acquires the compressed bitstream of the point cloud data, the second determination module 902 is further configured to:
[0416] In at least one of the point cloud data, fragmentation layer, macroblock layer and octree level, determine whether the point cloud data adopts a geometric pattern by at least one of the following:
[0417] Should we use the default mode?
[0418] Pattern information parsed from parameter sets or compressed bitstreams;
[0419] The corresponding mode information is determined based on the default parameter information used;
[0420] The corresponding mode information is determined from the parameter information parsed from the parameter set or compressed bitstream.
[0421] In one optional implementation, the parameter information includes at least one of the following: whether there are prediction tree neighbor nodes during macroblock partitioning; density during macroblock partitioning; bounding box information of hierarchical nodes; hierarchical threshold range; number of hierarchical nodes; and the number of hierarchical nodes determined based on the relationship between the number of point cloud points contained and a third predetermined number.
[0422] The apparatus in this application embodiment can execute the method provided in this application embodiment, and the implementation principle is similar. The actions performed by each module in the apparatus of each embodiment of this application correspond to the steps in the method of each embodiment of this application. For detailed functional descriptions of each module of the apparatus, please refer to the descriptions in the corresponding methods shown above, which will not be repeated here.
[0423] This application provides an electronic device including a memory, a processor, and a computer program stored in the memory. The processor executes the computer program to implement the steps of the various method embodiments. Optionally, the electronic device may refer to... Figure 2 The decoding device 202, or electronic device, in the point cloud data processing system 20 shown can refer to... Figure 2 The encoding device 201 in the point cloud data processing system 20 shown.
[0424] In one alternative embodiment, an electronic device is provided, such as Figure 10 As shown, Figure 10 The illustrated electronic device 4000 includes a processor 4001 and a memory 4003. The processor 4001 and the memory 4003 are connected, for example, via a bus 4002. Optionally, the electronic device 4000 may further include a transceiver 4004, which can be used for data interaction between the electronic device and other electronic devices, such as sending and / or receiving data. It should be noted that in practical applications, the transceiver 4004 is not limited to one type, and the structure of the electronic device 4000 does not constitute a limitation on the embodiments of this application.
[0425] Processor 4001 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 4001 may also be a combination that implements computational functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.
[0426] Bus 4002 may include a pathway for transmitting information between the aforementioned components. Bus 4002 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. Bus 4002 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 10 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.
[0427] The memory 4003 may be ROM (Read Only Memory) or other types of static storage devices capable of storing static information and instructions, RAM (Random Access Memory) or other types of dynamic storage devices capable of storing information and instructions, or EEPROM (Electrically Erasable Programmable Read Only Memory), CD-ROM (Compact Disc Read Only Memory) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media, other magnetic storage devices, or any other medium capable of carrying or storing computer programs and capable of being read by a computer, without limitation herein.
[0428] The memory 4003 stores computer programs that execute embodiments of this application, and its execution is controlled by the processor 4001. The processor 4001 executes the computer programs stored in the memory 4003 to implement the steps shown in the foregoing method embodiments.
[0429] This application provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it can implement the steps and corresponding content of the aforementioned method embodiments.
[0430] This application also provides a computer program product, including a computer program that, when executed by a processor, can implement the steps and corresponding content of the aforementioned method embodiments.
[0431] The terms "first," "second," "third," "fourth," "1," "2," etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in a sequence other than that shown in the figures or text.
[0432] It should be understood that although arrows indicate various operation steps in the flowcharts of this application's embodiments, the order in which these steps are implemented is not limited to the order indicated by the arrows. Unless explicitly stated herein, in some implementation scenarios of this application's embodiments, the implementation steps in each flowchart can be executed in other orders as required. Furthermore, some or all steps in each flowchart, based on the actual implementation scenario, may include multiple sub-steps or multiple stages. Some or all of these sub-steps or stages can be executed at the same time, and each sub-step or stage can also be executed at different times. In scenarios where execution times differ, the execution order of these sub-steps or stages can be flexibly configured according to requirements, and this application's embodiments do not limit this.
[0433] The above are only optional implementation methods for some implementation scenarios of this application. It should be noted that for those skilled in the art, other similar implementation methods based on the technical concept of this application, without departing from the technical concept of this application, also fall within the protection scope of the embodiments of this application.
Claims
1. A point cloud data processing method, characterized in that, include: Obtain the compressed bitstream of point cloud data; For the first node to be decoded in the compressed bitstream, determine the node information of the already decoded second node associated with the first node; Based on the node information of the decoded second node, determine whether to enter the isolated point mode judgment for the first node; If, based on the node information of the decoded second node, it is determined that the isolated point mode determination for the first node should not be entered, then the isolated point mode determination for the first node is skipped. The decoded second node associated with the first node includes at least one of the following: The decoded parent node of the first node; The decoded neighbor nodes of the first node; The decoded grandparent node where the parent node is located; The decoded neighbor nodes of the parent node; The decoded predecessor node of the first node; If the second node is at least one of the decoded parent node of the first node and the decoded grandparent node of the parent node, the node information of the second node includes the node side length of the second node. The determination of whether to enter the isolated point mode for the first node based on the node information of the decoded second node includes: Based on the relationship between the ratio of the maximum to the minimum side length of the bounding box of the second node and the third threshold, it is determined whether to enter the isolated point mode judgment for the first node.
2. The method according to claim 1, characterized in that, If the second node is at least one of the decoded parent node of the first node and the decoded grandparent node of the parent node, the node information of the second node shall also include at least one of the following: the number of point cloud points contained in the second node, the number of nodes occupied by the second node, and the distribution of the occupied nodes of the second node. The determination of whether to enter the isolated point mode for the first node based on the node information of the decoded second node further includes at least one of the following methods: Based on the relationship between the number of point cloud points contained in the second node and the first threshold, it is determined whether to enter the isolated point mode judgment for the first node. Based on the relationship between the number of occupied nodes of the second node and the second threshold, it is determined whether to enter the isolated point mode judgment for the first node. Based on the specified direction and the distribution of occupied nodes of the second node, determine whether to enter the isolated point mode for at least two first nodes in the specified direction. Based on the relationship between the index value of the first node in the parent node and the predetermined index value, it is determined whether to enter the isolated point mode for the first node.
3. The method according to claim 1, characterized in that, If the second node is at least one of the decoded neighbor node of the first node and the decoded neighbor node of the parent node; The determination of whether to enter the isolated point mode for the first node based on the node information of the decoded second node includes at least one of the following methods: If the first node and the occupied second node are in the same direction, or the number of nodes of the occupied second node is greater than the fourth threshold, it is determined that the isolated point mode determination for the first node will be entered; otherwise, it is determined that the isolated point mode determination for the first node will not be entered. If the child node of the second node that is adjacent to the first node is occupied, it is determined that the isolated point mode judgment for the first node will not be entered. If the child node of the second node that is adjacent to the first node is occupied and is not in isolated point mode, it is determined not to enter the isolated point mode determination for the first node. Based on the relationship between the proportion of isolated points in the child nodes of the second node and the fifth threshold, it is determined whether to enter the isolated point mode judgment for the first node. Based on the relationship between the isolated point in the second node that is closest to the first node and the distance to the first node and the sixth threshold, it is determined whether to enter the isolated point mode judgment for the first node.
4. The method according to claim 1, characterized in that, If the second node is the predecessor node of the first node, the node information of the second node includes at least one of the following: The number of empty nodes corresponding to the first predetermined number of non-empty predecessor nodes; The number of nodes in the preceding nodes that use the isolated point pattern; The number of child nodes in the preceding node is the second predetermined number of nodes.
5. The method according to claim 1, characterized in that, The determination of whether to enter the isolated point mode for the first node based on the node information of the decoded second node includes: Based on the geometric pattern information of the decoded second node, determine whether to enter the isolated point mode judgment for the first node.
6. The method according to claim 1, characterized in that, Also includes: If the first node is the node corresponding to the preset interval, then the isolated point mode determination for the first node is entered.
7. The method according to any one of claims 1-6, characterized in that, After determining that the first node adopts the isolated point mode, the following steps are also included: A reference node is determined based on at least one of the following methods, and a geometric residual value is parsed based on the reference node, the geometric residual value being used to decode the first node: The nearest octree node with a placeholder code of 1 in the sequence; At least one of the bounding box information and hierarchy information of the first node; The nearest decoded outlier in sequence; Isolated point already decoded on the same layer.
8. The method according to any one of claims 1-6, characterized in that, It also includes at least one of the following: Determine whether to enter the predetermined geometric mode judgment for the first node, and do not use the node in the second node that adopts the isolated point mode as the reference node; If there is a node in the second node that adopts the isolated point mode, the predetermined geometric mode determination for the first node will not be performed.
9. The method according to any one of claims 1-6, characterized in that, After obtaining the compressed bitstream of the point cloud data, the method further includes: In at least one of the point cloud data, the fragmentation layer, the macroblock layer, and the octree level, it is determined whether the point cloud data adopts a geometric pattern by at least one of the following: Should we use the default mode? Pattern information parsed from the parameter set or the compressed bitstream; The corresponding mode information is determined based on the default parameter information used; The corresponding mode information is determined from the parameter information parsed from the parameter set or the compressed bitstream.
10. The method according to claim 9, characterized in that, The parameter information includes at least one of the following: Are there prediction tree neighbor nodes during macroblock partitioning? Density during macroblock partitioning; Bounding box information of hierarchical nodes; Hierarchical threshold range; The number of hierarchical nodes; The number of hierarchical nodes is determined based on the relationship between the number of point cloud points and the third predetermined number.
11. A point cloud data processing method, characterized in that, include: Obtain the point cloud data to be encoded; For the fourth node to be encoded in the point cloud data, determine the node information of the already encoded fifth node related to the fourth node; Based on the node information of the encoded fifth node, determine whether to enter the isolated point mode judgment for the fourth node; If, based on the node information of the encoded fifth node, it is determined that the isolated point mode for the fourth node will not be entered, then the isolated point mode determination for the fourth node is skipped. The fifth node associated with the fourth node includes at least one of the following: The encoded parent node of the fourth node; The coded neighbor nodes of the fourth node; The encoded grandparent node where the parent node is located; The encoded neighbor nodes of the parent node; The encoded predecessor node of the fourth node; If the fifth node is at least one of the encoded parent node of the fourth node and the encoded neighbor node of the parent node, the node information of the fifth node includes the node side length of the fifth node. The step of determining whether to enter the isolated point mode judgment for the fourth node based on the node information of the encoded fifth node includes: Based on the relationship between the ratio of the maximum to the minimum side length of the bounding box of the fifth node and the third threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
12. The method according to claim 11, characterized in that, If the fifth node is at least one of the encoded parent node of the fourth node and the encoded neighbor node of the parent node, the node information of the fifth node further includes at least one of the following: the number of point cloud points contained in the fifth node, the number of occupied nodes of the fifth node, and the distribution of occupied nodes of the fifth node. The determination of whether to enter the isolated point mode judgment for the fourth node based on the node information of the encoded fifth node also includes at least one of the following methods: Based on the relationship between the number of point cloud points contained in the fifth node and the first threshold, it is determined whether to enter the isolated point mode judgment for the fourth node. Based on the relationship between the number of occupied nodes of the fifth node and the second threshold, it is determined whether to enter the isolated point mode judgment for the fourth node. Based on the specified direction and the distribution of occupied nodes of the fifth node, determine whether to enter the isolated point mode for at least two fourth nodes in the specified direction. Based on the relationship between the index value of the fourth node in the parent node and the predetermined index value, it is determined whether to enter the isolated point mode judgment for the fourth node.
13. The method according to claim 11, characterized in that, If the fifth node is at least one of the encoded neighbor node of the fourth node and the encoded neighbor node of the parent node, the determination of whether to enter the isolated point mode determination for the fourth node based on the node information of the encoded fifth node includes at least one of the following methods: If the fourth node and the occupied fifth node are in the same direction, or the number of nodes of the occupied fifth node is greater than the fourth threshold, it is determined to enter the isolated point mode determination for the fourth node; otherwise, it is determined not to enter the isolated point mode determination for the fourth node. If the child node of the fifth node that is adjacent to the fourth node is occupied, it is determined that the isolated point mode determination for the fourth node will not be entered. If the child node of the fifth node that is adjacent to the fourth node is occupied and is not in isolated point mode, it is determined that the isolated point mode determination for the fourth node will not be entered. Based on the relationship between the proportion of isolated points in the child nodes of the fifth node and the fifth threshold, it is determined whether to enter the isolated point mode judgment for the fourth node. Based on the relationship between the isolated point in the fifth node that is closest to the fourth node and the distance to the fourth node and the sixth threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
14. The method according to claim 11, characterized in that, If the fifth node is the predecessor node of the fourth node, the node information of the fifth node includes at least one of the following: The number of empty nodes corresponding to the first predetermined number of non-empty predecessor nodes; The number of nodes in the preceding nodes that use the isolated point pattern; The number of child nodes in the preceding node is the second predetermined number of nodes.
15. The method according to claim 11, characterized in that, The step of determining whether to enter the isolated point mode judgment for the fourth node based on the node information of the encoded fifth node includes: Based on the geometric pattern information of the encoded fifth node, determine whether to proceed to the isolated point pattern determination for the fourth node.
16. The method according to claim 11, characterized in that, It also includes at least one of the following: If the fourth node is a node corresponding to a preset interval, then the isolated point mode determination for the fourth node is entered.
17. The method according to any one of claims 11-16, characterized in that, After determining that the fourth node adopts the isolated point mode, the following is also included: The reference node is determined based on at least one of the following methods, and the geometric residual value is parsed based on the reference node, the geometric residual value being used to encode the fourth node: The nearest octree node with a placeholder code of 1 in the sequence; At least one of the bounding box information and hierarchy information of the fourth node; The nearest coded outlier in sequence; Isolated points already coded in the same layer.
18. The method according to any one of claims 11-16, characterized in that, It also includes at least one of the following: Determine whether to enter the predetermined geometric pattern judgment for the fourth node, and do not use the node in the fifth node that adopts the isolated point pattern as the reference node; If there is a node in the fifth node that adopts the isolated point mode, the predetermined geometric mode determination for the fourth node will not be performed.
19. The method according to any one of claims 11-16, characterized in that, After acquiring the point cloud data to be encoded, the process also includes: In at least one of the point cloud data, the fragmentation layer, the macroblock layer, and the octree level, it is determined whether the point cloud data adopts a geometric pattern by at least one of the following: Should we use the default mode? Pattern information parsed from the parameter set; The corresponding mode information is determined based on the default parameter information used; The corresponding pattern information is determined from the parameter information parsed from the parameter set.
20. The method according to claim 19, characterized in that, The parameter information includes at least one of the following: Are there prediction tree neighbor nodes during macroblock partitioning? Density during macroblock partitioning; Bounding box information of hierarchical nodes; Hierarchical threshold range; The number of hierarchical nodes; The number of hierarchical nodes is determined based on the relationship between the number of point cloud points and the third predetermined number.
21. A point cloud data processing device, characterized in that, include: The first acquisition module is used to acquire the compressed bitstream of point cloud data; The first determining module is used to determine the node information of a decoded second node associated with the first node to be decoded in the compressed bitstream. The first determination module is used to determine whether to enter the isolated point mode determination for the first node based on the node information of the decoded second node. The first skip module is used to skip the isolated point mode determination for the first node if it is determined, based on the node information of the decoded second node, that the isolated point mode determination for the first node should not be entered. The decoded second node associated with the first node includes at least one of the following: The decoded parent node of the first node; The decoded neighbor nodes of the first node; The decoded grandparent node where the parent node is located; The decoded neighbor nodes of the parent node; The decoded predecessor node of the first node; If the second node is at least one of the decoded parent node of the first node and the decoded grandparent node of the parent node, the node information of the second node includes the node side length of the second node. When the first determination module determines whether to enter the isolated point mode determination for the first node based on the node information of the decoded second node, it is specifically used for: Based on the relationship between the ratio of the maximum to the minimum side length of the bounding box of the second node and the third threshold, it is determined whether to enter the isolated point mode judgment for the first node.
22. The apparatus according to claim 21, characterized in that, If the second node is at least one of the decoded parent node of the first node and the decoded grandparent node of the parent node, the node information of the second node shall also include at least one of the following: the number of point cloud points contained in the second node, the number of nodes occupied by the second node, and the distribution of the occupied nodes of the second node. When determining whether to enter the isolated point mode determination for the first node based on the node information of the decoded second node, the first determination module is also specifically used for at least one of the following: Based on the relationship between the number of point cloud points contained in the second node and the first threshold, it is determined whether to enter the isolated point mode judgment for the first node. Based on the relationship between the number of occupied nodes of the second node and the second threshold, it is determined whether to enter the isolated point mode judgment for the first node. Based on the specified direction and the distribution of occupied nodes of the second node, determine whether to enter the isolated point mode for at least two first nodes in the specified direction. Based on the relationship between the index value of the first node in the parent node and the predetermined index value, it is determined whether to enter the isolated point mode for the first node.
23. The apparatus according to claim 21, characterized in that, If the second node is at least one of the decoded neighbor node of the first node and the decoded neighbor node of the parent node; When the first determination module determines whether to enter the isolated point mode determination for the first node based on the node information of the decoded second node, it is specifically used for at least one of the following: If the first node and the occupied second node are in the same direction, or the number of nodes of the occupied second node is greater than the fourth threshold, it is determined that the isolated point mode determination for the first node will be entered; otherwise, it is determined that the isolated point mode determination for the first node will not be entered. If the child node of the second node that is adjacent to the first node is occupied, it is determined that the isolated point mode judgment for the first node will not be entered. If the child node of the second node that is adjacent to the first node is occupied and is not in isolated point mode, it is determined not to enter the isolated point mode determination for the first node. Based on the relationship between the proportion of isolated points in the child nodes of the second node and the fifth threshold, it is determined whether to enter the isolated point mode judgment for the first node. Based on the relationship between the isolated point in the second node that is closest to the first node and the distance to the first node and the sixth threshold, it is determined whether to enter the isolated point mode judgment for the first node.
24. The apparatus according to claim 21, characterized in that, If the second node is the predecessor node of the first node, the node information of the second node includes at least one of the following: The number of empty nodes corresponding to the first predetermined number of non-empty predecessor nodes; The number of nodes in the preceding nodes that use the isolated point pattern; The number of child nodes in the preceding node is the second predetermined number of nodes.
25. The apparatus according to claim 21, characterized in that, When the first determination module determines whether to enter the isolated point mode determination for the first node based on the node information of the decoded second node, it is specifically used for: Based on the geometric pattern information of the decoded second node, determine whether to enter the isolated point mode judgment for the first node.
26. The apparatus according to claim 21, characterized in that, Also includes: The first entry module is used to determine the isolated point mode for the first node if the first node is a node corresponding to a preset interval.
27. The apparatus according to any one of claims 21-26, characterized in that, Also includes: The decoding module, after determining that the first node adopts the isolated point mode, is used for: A reference node is determined based on at least one of the following methods, and a geometric residual value is parsed based on the reference node, the geometric residual value being used to decode the first node: The nearest octree node with a placeholder code of 1 in the sequence; At least one of the bounding box information and hierarchy information of the first node; The nearest decoded outlier in sequence; Isolated point already decoded on the same layer.
28. The apparatus according to any one of claims 21-26, characterized in that, The first determination module is also used for: Determine whether to enter the predetermined geometric mode judgment for the first node, and do not use the node in the second node that adopts the isolated point mode as the reference node; If there is a node in the second node that adopts the isolated point mode, the predetermined geometric mode determination for the first node will not be performed.
29. The apparatus according to any one of claims 21-26, characterized in that, After the first acquisition module acquires the compressed bitstream of the point cloud data, the first determination module is further configured to: In at least one of the point cloud data, the fragmentation layer, the macroblock layer, and the octree level, it is determined whether the point cloud data adopts a geometric pattern by at least one of the following: Should we use the default mode? Pattern information parsed from the parameter set or the compressed bitstream; The corresponding mode information is determined based on the default parameter information used; The corresponding mode information is determined from the parameter information parsed from the parameter set or the compressed bitstream.
30. The apparatus according to claim 29, characterized in that, The parameter information includes at least one of the following: Are there prediction tree neighbor nodes during macroblock partitioning? Density during macroblock partitioning; Bounding box information of hierarchical nodes; Hierarchical threshold range; The number of hierarchical nodes; The number of hierarchical nodes is determined based on the relationship between the number of point cloud points and the third predetermined number.
31. A point cloud data processing device, characterized in that, include: The second acquisition module is used to acquire point cloud data to be encoded; The second determining module is used to determine the node information of the already encoded fifth node related to the fourth node in the point cloud data for the fourth node to be encoded. The second determination module is used to determine whether to enter the isolated point mode determination for the fourth node based on the node information of the encoded fifth node. The second skip module is used to skip the isolation point mode determination for the fourth node if it is determined, based on the node information of the encoded fifth node, that the isolation point mode for the fourth node should not be entered. The fifth node associated with the fourth node includes at least one of the following: The encoded parent node of the fourth node; The coded neighbor nodes of the fourth node; The encoded grandparent node where the parent node is located; The encoded neighbor nodes of the parent node; The encoded predecessor node of the fourth node; If the fifth node is at least one of the encoded parent node of the fourth node and the encoded neighbor node of the parent node, the node information of the fifth node includes the node side length of the fifth node. When the second determination module determines whether to enter the isolated point mode determination for the fourth node based on the node information of the encoded fifth node, it is specifically used for: Based on the relationship between the ratio of the maximum to the minimum side length of the bounding box of the fifth node and the third threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
32. The apparatus according to claim 31, characterized in that, If the fifth node is at least one of the encoded parent node of the fourth node and the encoded neighbor node of the parent node, the node information of the fifth node further includes at least one of the following: the number of point cloud points contained in the fifth node, the number of occupied nodes of the fifth node, and the distribution of occupied nodes of the fifth node. When the second determination module determines whether to enter the isolated point mode determination for the fourth node based on the node information of the encoded fifth node, it is also specifically used for at least one of the following: Based on the relationship between the number of point cloud points contained in the fifth node and the first threshold, it is determined whether to enter the isolated point mode judgment for the fourth node. Based on the relationship between the number of occupied nodes of the fifth node and the second threshold, it is determined whether to enter the isolated point mode judgment for the fourth node. Based on the specified direction and the distribution of occupied nodes of the fifth node, determine whether to enter the isolated point mode for at least two fourth nodes in the specified direction. Based on the relationship between the index value of the fourth node in the parent node and the predetermined index value, it is determined whether to enter the isolated point mode judgment for the fourth node.
33. The apparatus according to claim 31, characterized in that, If the fifth node is at least one of the encoded neighbor node of the fourth node and the encoded neighbor node of the parent node, the second determination module, when determining whether to enter the isolated point mode determination for the fourth node based on the node information of the encoded fifth node, is specifically used for at least one of the following: If the fourth node and the occupied fifth node are in the same direction, or the number of nodes of the occupied fifth node is greater than the fourth threshold, it is determined to enter the isolated point mode determination for the fourth node; otherwise, it is determined not to enter the isolated point mode determination for the fourth node. If the child node of the fifth node that is adjacent to the fourth node is occupied, it is determined that the isolated point mode determination for the fourth node will not be entered. If the child node of the fifth node that is adjacent to the fourth node is occupied and is not in isolated point mode, it is determined that the isolated point mode determination for the fourth node will not be entered. Based on the relationship between the proportion of isolated points in the child nodes of the fifth node and the fifth threshold, it is determined whether to enter the isolated point mode judgment for the fourth node. Based on the relationship between the isolated point in the fifth node that is closest to the fourth node and the distance to the fourth node and the sixth threshold, it is determined whether to enter the isolated point mode judgment for the fourth node.
34. The apparatus according to claim 31, characterized in that, If the fifth node is the predecessor node of the fourth node, the node information of the fifth node includes at least one of the following: The number of empty nodes corresponding to the first predetermined number of non-empty predecessor nodes; The number of nodes in the preceding nodes that use the isolated point pattern; The number of child nodes in the preceding node is the second predetermined number of nodes.
35. The apparatus according to claim 31, characterized in that, When the second determination module determines whether to enter the isolated point mode determination for the fourth node based on the node information of the encoded fifth node, it is specifically used for: Based on the geometric pattern information of the encoded fifth node, determine whether to proceed to the isolated point pattern determination for the fourth node.
36. The apparatus according to claim 31, characterized in that, Also includes: The second entry module is used to determine the isolated point mode for the fourth node if the fourth node is a node corresponding to a preset interval.
37. The apparatus according to any one of claims 31-36, characterized in that, Also includes: An encoding module is configured to determine a reference node based on at least one of the following methods, and to parse geometric residual values based on the reference node, the geometric residual values being used to encode the fourth node: The nearest octree node with a placeholder code of 1 in the sequence; At least one of the bounding box information and hierarchy information of the fourth node; The nearest coded outlier in sequence; Isolated points already coded in the same layer.
38. The apparatus according to any one of claims 31-36, characterized in that, The second determination module is also used for at least one of the following: Determine whether to enter the predetermined geometric pattern judgment for the fourth node, and do not use the node in the fifth node that adopts the isolated point pattern as the reference node; If there is a node in the fifth node that adopts the isolated point mode, the predetermined geometric mode determination for the fourth node will not be performed.
39. The method according to any one of claims 31-36, characterized in that, After the second acquisition module acquires the point cloud data to be encoded, the second determination module is further configured to: In at least one of the point cloud data, the fragmentation layer, the macroblock layer, and the octree level, it is determined whether the point cloud data adopts a geometric pattern by at least one of the following: Should we use the default mode? Pattern information parsed from the parameter set; The corresponding mode information is determined based on the default parameter information used; The corresponding pattern information is determined from the parameter information parsed from the parameter set.
40. The apparatus according to claim 39, characterized in that, The parameter information includes at least one of the following: Are there prediction tree neighbor nodes during macroblock partitioning? Density during macroblock partitioning; Bounding box information of hierarchical nodes; Hierarchical threshold range; The number of hierarchical nodes; The number of hierarchical nodes is determined based on the relationship between the number of point cloud points and the third predetermined number.
41. An electronic device comprising a memory, a processor, and a computer program stored in the memory, characterized in that, The processor executes the computer program to implement the method according to any one of claims 1-10 or 11-20.
42. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1-10 or 11-20.
43. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1-10 or 11-20.
