Point Cloud Processing

The two-layer-based point cloud encoding structure with PLR metadata enhances the quality of dynamic point clouds, addressing the challenge of efficient compression for virtual reality and self-driving cars by reducing bitrate while maintaining high fidelity.

JP7578625B2Active Publication Date: 2024-11-06INTERDIGITALCE PATENT HLDG SAS
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2021574782
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-07-03
Filing Date
2020-06-22
Publication Date
2024-11-06
Estimated Expiration
2040-06-22

AI Technical Summary

Technical Problem

Existing point cloud compression methods struggle to efficiently deliver dynamic point clouds with high quality while maintaining a reasonable bitrate, especially for applications like virtual reality and self-driving cars, where dynamic point clouds are frequently captured and require efficient compression for practical delivery.

Method used

A method involving a two-layer-based point cloud encoding structure that includes a base layer for lossy representation and an enhancement layer for additional details, using point-local reconstruction (PLR) metadata to enhance quality without increasing bitrate significantly.

Benefits of technology

The proposed method allows for higher quality reconstruction of point clouds with reduced bitrate, improving the fidelity of dynamic point clouds in applications like virtual reality and self-driving cars by effectively utilizing PLR metadata to generate additional 3D samples.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007578625000020
    Figure 0007578625000020
  • Figure 0007578625000021
    Figure 0007578625000021
  • Figure 0007578625000022
    Figure 0007578625000022
Patent Text Reader

Abstract

At least one embodiment relates to a method for encoding, signaling, and decoding a 3D point cloud with different layers associated with point local reconstruction information and modes. A layer may be associated with its own information and modes, or the associated metadata may include an index to the information or modes encoded or decoded in relation to different layers.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] At least one of the present embodiments generally relates to processing point clouds. [Background technology]

[0002] This section is intended to introduce the reader to various aspects of the art, which may be related to various aspects of at least one of the present embodiments described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of at least one embodiment.

[0003] Point clouds can be used for various purposes, such as cultural heritage / architecture, to scan objects such as statues or buildings in 3D to share the spatial configuration of the object without sending or visiting it, and as a way to ensure that knowledge of the object is preserved in case it is destroyed, e.g. a temple may be destroyed by an earthquake. Such point clouds are usually static, colored and huge.

[0004] Another use case is in topography and cartography, where using a 3D representation the map is not limited to a flat surface but can include relief. Currently, Google Maps is a good example of a 3D map, but it uses a mesh rather than a point cloud. Nevertheless, point clouds may be the preferred data format for 3D maps, and such point clouds are usually static, colored, and large.

[0005] The automotive industry and autonomous vehicles are also areas where point clouds can be used. An autonomous vehicle should be able to "spy" on its environment to make good driving decisions based on the reality in its immediate vicinity. Typical sensors like LIDAR (LIght Detection And Ranging) generate dynamic point clouds that are used in decision engines. These point clouds are not intended for human viewing, are typically small, not necessarily colored, and are dynamic since they are captured at a high frequency. These point clouds may have other attributes like reflectivity provided by LIDAR, which may be useful for decision making since this attribute is good information about the material of the sensed object.

[0006] Virtual reality and immersive worlds have been a hot topic lately, with many predicting them as the future of 2D flat video. The basic idea is to immerse the viewer in the environment around them, as opposed to standard television, where the viewer can only see the virtual world in front of them. There are several stages of immersion, depending on the viewer's degree of freedom in the environment. Point clouds are a good format candidate for delivering virtual reality (VR) worlds.

[0007] In many applications it is important to be able to deliver dynamic point clouds to end users (or store them on a server) while consuming only a reasonable amount of bitrate (or storage space for storage applications) while maintaining an acceptable (or preferably very good) quality of experience. Efficient compression of these dynamic point clouds is key to making the delivery chain of immersive worlds practical.

[0008] With the above in mind, at least one embodiment has been conceived. Summary of the Invention

[0009] The following presents a simplified summary of at least one of the present embodiments in order to provide a basic understanding of some aspects of the present embodiments. This summary is not an extensive overview of an embodiment. It is not intended to identify key or critical elements of an embodiment. The following summary merely presents some aspects of at least one of the present embodiments in a simplified form as a prelude to the more detailed description provided elsewhere in this document.

[0010] According to a general aspect of at least one embodiment, a method is provided that includes decoding first metadata associated with a first layered image from a data stream. The metadata includes a first flag indicating whether the first layered image is decoded according to a point local reconstruction method. If the first flag is enabled, the method further includes obtaining first point local reconstruction information and a first point local reconstruction mode in the first metadata, and applying the first point local reconstruction mode to the first layered image according to the first point local reconstruction information to reconstruct the 3D point cloud.

[0011] According to other aspects, point local reconstruction information and / or modes may be omitted in the metadata if an index is indicated in the metadata of the current layer that allows for obtaining these data from metadata associated with another layer.

[0012] According to another aspect, a second method is provided, the method including encoding a first layered image and associated first metadata in a data stream, the metadata comprising: a first flag indicating whether the first layered image is decoded according to a point local reconstruction method; If the first flag is enabled, first point local reconstruction information and a first point local reconstruction mode.

[0013] According to another aspect of the second method, point local reconstruction information and / or modes may be omitted in the metadata if an index is indicated in the metadata of the current layer that allows for obtaining these data from metadata associated with another layer.

[0014] According to another aspect, an apparatus is provided, the apparatus including a processor, the processor may be configured to encode or decode a 3D point cloud by performing any of the methods described above.

[0015] According to another general aspect of at least one embodiment, a signal is provided that includes data generated in accordance with any of the described encoding embodiments or variations.

[0016] According to another general aspect of at least one embodiment, a bitstream is formatted to include data content generated according to any of the described coding embodiments or variations.

[0017] According to another general aspect of at least one embodiment, a computer program product is provided that includes instructions that, when executed by a computer, cause the computer to perform any of the described decoding embodiments or variations.

[0018] These and other aspects, features, and advantages of the general aspects will become apparent from the following detailed description of illustrative embodiments, which is to be read in connection with the accompanying drawings. [Brief description of the drawings]

[0019] The drawings illustrate some example embodiments. [Figure 1] FIG. 2 shows a schematic block diagram of an example of a two-layer based point cloud coding structure according to at least one of the present embodiments. [Diagram 2]FIG. 2 shows a schematic block diagram of an example of a two-layer based point cloud decoding structure according to at least one of the present embodiments. [Diagram 3] 1 shows a schematic block diagram of an example image-based point cloud encoder according to at least one of the present embodiments. [Figure 3a] Here is an example canvas containing two patches and their 2D bounding boxes. [Figure 4] 1 shows a schematic block diagram of an example image-based point cloud decoder according to at least one of the present embodiments. [Diagram 5] 1 illustrates a schematic example syntax of a bitstream representing a base layer BL according to at least one of the present embodiments. [Figure 6] 1 illustrates a block diagram of an example system in which various aspects and embodiments may be implemented. [Figure 7] 7 diagrammatically illustrates a method 700 for decoding a 3D point cloud in accordance with the present principles. [Figure 8] 8 illustrates diagrammatically a method 800 for encoding a 3D point cloud in accordance with the present principles. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] At least one of the present embodiments will be described in more detail below with reference to the attached figures, in which at least one example of the present embodiments is shown. However, an embodiment may be embodied in many alternative forms and should not be construed as being limited to the examples set forth herein. Therefore, it is to be understood that there is no intention to limit the embodiments to the specific forms disclosed. On the contrary, the present disclosure is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present application.

[0021] Where a diagram is presented as a flow diagram, it should be understood that it also provides a block diagram of the corresponding apparatus. Similarly, where a diagram is presented as a block diagram, it should be understood that it also provides a flow diagram of the corresponding method / process.

[0022] Similar or identical elements are referred to with the same reference numbers.

[0023] Some figures represent syntax tables that are widely used in V-PCC to define the structure of bitstreams that comply with V-PCC. In these syntax tables, the term "..." indicates an unchanged part of the syntax with respect to the original definition specified in V-PCC and removed from the figures for readability. A bolded term in the figure indicates that the value of this term is obtained by parsing the bitstream. The right column of the syntax table indicates the number of bits to encode the data of the syntax element. For example, u(4) indicates that 4 bits are used to encode the data, u(8) indicates 8 bits, and ae(v) indicates the context-adaptive arithmetic entropy coding syntax element.

[0024] The aspects described and contemplated below can be implemented in many different forms. Figures 1-15 below provide some embodiments, but other embodiments are contemplated and the discussion of Figures 1-15 is not intended to limit the scope of those implementations.

[0025] At least one of these aspects relates generally to point cloud encoding and decoding, and at least one other aspect relates generally to transmitting the generated or encoded bitstream.

[0026] More precisely, various methods and other aspects described in this specification may be used to modify modules, e.g., modules related to metadata encoding such as those performed in the patch information encoder 3700 of FIG. 3, and modules related to metadata decoding such as those performed in the patch information decoder 4400 of FIG. 4, or in the reconstruction process of the geometry generation module 4500 of FIG. 4.

[0027] Further, the aspects are not limited to MPEG standards, such as MPEG-I Part 5 for point cloud compression, but may be applied, for example, to other standards and recommendations, whether existing or developed in the future, and extensions of such standards and recommendations, including MPEG-I Part 5. Unless otherwise indicated or technically excluded, the aspects described in this application may be used individually or in any combination.

[0028] In the following, image data refers to data of one or several arrays of 2D samples in a particular image / video format. A particular image / video format may specify information about pixel values ​​of an image (or video). A particular image / video format may also specify information that can be used by a display and / or any other device, for example, to visualize and / or decode the image (or video). An image typically includes a first component, usually representing the luminance (or luma) of the image, in the shape of a first 2D array of samples. An image may also include a second and a third component, usually representing the chrominance (or chroma) of the image, in the shape of another 2D array of samples. Some embodiments represent the same information using a set of 2D arrays of color samples, such as the conventional three-color RGB representation.

[0029] A pixel value, in one or more embodiments, is represented by a vector of C values, where C is the number of components. Each value in the vector is typically represented by a number of bits that may define the maximum dynamic range of the pixel value.

[0030] An image block refers to a set of pixels that belong to an image. The pixel values ​​of an image block (or image block data) refer to the values ​​of the pixels that belong to this image block. Image blocks can be of any shape, but rectangular shapes are common.

[0031] A point cloud may represent a data set of 3D samples in a 3D volumetric space that have unique coordinates and may have one or more attributes.

[0032] A 3D sample of the data set may be defined by its spatial location (X, Y, and Z coordinates in 3D space) and possibly by one or more associated attributes, such as color, transparency, reflectance, a two-component normal vector, or any feature that represents a characteristic of this sample, e.g., expressed in RGB or YUV color space. For example, a 3D sample may be defined by a six-component point (X,Y,Z,R,G,B) or equivalently (X,Y,Z,y,U,V), where (X,Y,Z) define the coordinates of the point in 3D space and (R,G,B) or (y,U,V) define the color of this 3D sample. Attributes of the same type may be present multiple times. For example, multiple color attributes may provide color information from different perspectives.

[0033] A point cloud can be static or dynamic, depending on whether the cloud changes over time. An instance of a static or dynamic point cloud is typically denoted as a point cloud frame. For a dynamic point cloud, the number of points is typically not constant, but rather typically changes over time. More generally, a point cloud may be considered dynamic if there is something that changes over time, such as the number of points, the location of one or more points, or any attribute of any point.

[0034] As an example, a 2D sample may be defined by six components (u,v,Z,R,G,B) or equivalently (u,v,Z,y,U,V). (u,v) define the coordinates of the 2D sample in the 2D space of the projection plane. Z is the depth value of the 3D sample projected onto this projection plane. (R,G,B) or (y,U,V) define the color of this 3D sample.

[0035] According to the present principles, a flag is information encoded in a data stream that indicates whether a condition is enabled. For example, a flag is information that indicates whether a processor needs to perform an action when encoding or decoding a data stream. In another example, a flag is information that indicates whether a sequence of bits in a data stream conforms to a given syntax. A flag may also be a first piece of information that indicates whether a second piece of information is encoded in the data stream. If a condition is conformed, the flag is said to be enabled. A flag may be encoded by various methods and / or bit sequences in a data stream.

[0036] FIG. 1 shows a schematic block diagram of an example of a two-layer based point cloud coding structure 1000 according to at least one of the present embodiments.

[0037] The two-layer based point cloud coding structure 1000 may provide a bitstream B representing an input point cloud frame IPCF, possibly representing a frame of a dynamic point cloud, which may then be coded by the two-layer based point cloud coding structure 1000 independently of other frames.

[0038] Essentially, the two-layer based point cloud coding structure 1000 may provide the ability to structure a bitstream B as a base layer BL and an enhancement layer EL. The base layer BL may provide a lossy representation of the input point cloud frame IPCF, and the enhancement layer EL may provide a higher quality (possibly lossless) representation by encoding isolated points not represented by the base layer BL.

[0039] The base layer BL may be provided by an image-based encoder 3000 as shown in Fig. 3, which may provide geometry / texture images representing the geometry / attributes of the 3D samples of the input point cloud IPCF, which may allow discarding isolated 3D samples. The base layer BL may be decoded by an image-based decoder 4000 as shown in Fig. 4, which may provide an intermediate reconstructed point cloud frame IRPCF.

[0040] Returning now to the two-layer based point cloud encoding 1000 of FIG. 1, a comparator COMP may compare the 3D samples of the input point cloud frame IPCF with the 3D samples of the intermediate reconstructed point cloud frame IRPCF to detect / locate the missing / separated 3D samples. Then, an encoder ENC may encode the missing 3D samples and provide an enhancement layer EL. Finally, the base layer BL and the enhancement layer EL may be multiplexed together by a multiplexer MUX to generate a bitstream B.

[0041] According to one embodiment, the encoder ENC may comprise a detector capable of detecting and associating the 3D reference samples R of the intermediate reconstruction point cloud IRPCF with the missing 3D samples M.

[0042] For example, a 3D reference sample R associated with a missing 3D sample M may be a nearest neighbor of M according to a given metric.

[0043] According to one embodiment, the encoder ENC may then encode the spatial positions of the missing 3D samples M and their attributes as differences determined according to the spatial positions and attributes of said 3D reference samples R.

[0044] In a variant, these differences may be coded separately.

[0045] For example, for a missing 3D sample M with spatial coordinates x(M), y(M), and z(M), the position difference of the x coordinate Dx(M), the position difference of the y coordinate Dy(M), the position difference of the z coordinate Dz(M), the component difference of the R attribute Dr(M), the component difference of the G attribute Dg(M), and the component difference of the B attribute Db(M) may be calculated as follows: Dx(M)=x(M)-x(R) where x(M) is the x coordinate of the 3D sample M, respectively R, in the geometry image provided by FIG. Dy(M) = y(M) - y(R) where y(M) is the y coordinate of the 3D sample M, respectively R, in the geometry image provided by FIG. Dz(M) = z(M) - z(R) where z(M) is the z coordinate of the 3D sample M, respectively R, in the geometry image provided by FIG. Dr(M)=R(M)-R(R) where R(M), respectively R(R), are the r-color components of the color attributes of the 3D sample M, respectively R; Dg(M) = G(M) - G(R) where G(M), respectively G(R), are the g-color components of the color attributes of the 3D samples M, respectively R; Db(M)=B(M)-B(R) where B(M), respectively B(R), are the b-color components of the color attributes of the 3D samples M, respectively R.

[0046] FIG. 2 shows a schematic block diagram of an example of a two-layer based point cloud decoding structure 2000 according to at least one of the present embodiments.

[0047] The operation of the two-layer based point cloud decoding structure 2000 depends on its functionality.

[0048] The limited functionality two-layer based point cloud decoding structure 2000 may access only the base layer BL from the bitstream B by using a demultiplexer DMUX, and then provide a faithful (but lossy) version IRPCF of the input point cloud frame IPCF by decoding the base layer BL by the point cloud decoder 4000, as shown in FIG. 4.

[0049] The full-featured two-layer based point cloud decoding structure 2000 may access both the base layer BL and the enhancement layer EL from the bitstream B by using a demultiplexer DMUX. As shown in FIG. 4, the point cloud decoder 4000 may determine an intermediate reconstructed point cloud frame IRPCF from the base layer BL. The decoder DEC may determine a complementary point cloud frame CPCF from the enhancement layer EL. The combiner COM may then combine the intermediate reconstructed point cloud frame IRPCF and the complementary point cloud frame CPCF, thus providing a higher quality (possibly lossless) representation (reconstructed) CRPCF of the input point cloud frame IPCF.

[0050] FIG. 3 shows a schematic block diagram of an example image-based point cloud encoder 3000 according to at least one of the present embodiments.

[0051] The image-based point cloud encoder 3000 utilizes existing video codecs to compress the geometry and texture (attribute) information of dynamic point clouds, essentially by converting the point cloud data into a series of different video sequences.

[0052] In a particular embodiment, two videos, one for capturing geometry information of the point cloud data and the other for capturing texture information, may be generated and compressed using an existing video codec. An example of an existing video codec is the HEVC Main Profile Encoder / Decoder (ITU-T H.265 ITU's Telecommunications Standardization Sector (02 / 2018), Series H: Audio-Visual and Multimedia Systems, Infrastructure for Audio-Visual Services (Coding of Moving Images, High Efficiency Video Coding, Recommendation ITU-T H.265)).

[0053] Additional metadata used to interpret the two videos is also typically generated and compressed separately, such as, for example, an occupancy map OM and / or auxiliary patch information PI.

[0054] The generated video bitstream and metadata may then be multiplexed together to generate a combined bitstream.

[0055] Note that metadata typically represents a small amount of the overall information; the majority of the information is in the video bitstream.

[0056] An example of such a point cloud encoding / decoding process is given by the Test Model Category 2 algorithm (also called V-PCC) implementing the MPEG draft standard defined in ISO / IEC JTC1 / SC29 / WG11 MPEG2019 / w18180 (January 2019, Marrakech).

[0057] In step 3100, the module PGM may generate at least one patch by decomposing 3D samples of a dataset representing the input point cloud IPCF into 2D samples on a projection plane using the strategy that provides the best compression.

[0058] A patch may be defined as a set of 2D samples.

[0059] For example, in V-PCC, the normals of all 3D samples are first estimated, as described, for example, in Hoppe et al. (Hugues Hoppe, Tony DeRose, Tom Duchamp, John McDonald, Werner Stuetzle. Surface reconstruction from unorganized points. ACM SIGGRAPH 1992 Proceedings, 71-78). Then, an initial clustering of the input point cloud frame IPCF is obtained by associating each 3D sample with one of six oriented planes of a 3D bounding box that encompasses the 3D samples of the input point cloud frame IPCF. More precisely, each 3D sample is clustered and associated with the oriented plane that has the closest normal (i.e., that maximizes the dot product of the point normal and the plane normal). The 3D samples are then projected onto their associated planes. A set of 3D samples that form a connected region in their planes is called a connected component. A connected component is a set of at least one 3D sample with similar normal and the same associated oriented plane. The initial clustering is then refined by iteratively updating the cluster associated with each 3D sample based on its normal and the clusters of its nearest neighbors. The final step consists of generating one patch from each connected component by projecting the 3D samples of each connected component onto the oriented plane associated with said connected component. The patches are associated with auxiliary patch information PI representing auxiliary patch information defined for each patch to interpret the projected 2D samples corresponding to geometry and / or attribute information.

[0060] For example, in V-PCC, the auxiliary patch information PI includes: 1) information indicating one of six oriented planes of a 3D bounding box enclosing the 3D sample of the connected component; 2) information about the plane normal; 3) information determining the 3D position of the connected component with respect to the patch expressed in terms of depth, tangential shift, and bi-tangential shift; and 4) information such as the coordinates (u0,v0,u1,v1) of the projection plane that defines the 2D bounding box enclosing the patch.

[0061] In step 3200, the patch packing module PPM may map (place) at least one generated patch onto a 2D grid (also called canvas), typically without overlap, in a manner that minimizes unused space, and may ensure that every T×T (e.g., 16×16) block of the 2D grid is associated with a unique patch. A given minimum block size T×T of the 2D grid may specify a minimum distance between distinct patches placed on this 2D grid. The resolution of the 2D grid may depend on the size of the input point cloud and its width W and height H, and the block size T may be transmitted to the decoder as metadata.

[0062] The auxiliary patch information PI may further include information regarding the association between blocks of the 2D grid and patches.

[0063] In V-PCC, the auxiliary information PI may include block to patch index information (BlockToPatch) that determines the association between blocks of the 2D grid and patch indices.

[0064] Figure 3a shows an example of a canvas C that includes two patches P1 and P2 and their associated 2D bounding boxes B1 and B2. Note that the two bounding boxes may overlap in the canvas C, as shown in Figure 3a. Although the 2D grid (canvas partitioning) is only represented inside the bounding boxes, canvas partitioning also occurs outside these bounding boxes. The bounding boxes associated with the patches can be partitioned into TxT blocks (typically T=16).

[0065] A T×T block containing 2D samples belonging to a patch may be considered as an occupied block in the corresponding occupancy map OM, which may indicate whether the block is occupied, i.e. whether it contains 2D samples belonging to the patch.

[0066] In Fig. 3a, occupied blocks are represented by white blocks and light grey blocks represent unoccupied blocks. The image generation process (steps 3300 and 3400) utilizes the mapping of at least one generated patch onto the 2D grid computed during step 3200 to store the geometry and texture of the input point cloud frame IPCF as an image.

[0067] In step 3300, a geometry image generator GIG may generate at least one geometry image GI from the input point cloud IPCF, the occupancy map OM, and the auxiliary patch information PI. The geometry image generator GIG may utilize the occupancy map information to detect (locate) occupied blocks and thus non-empty pixels in the geometry image GI.

[0068] The geometry image GI may represent the geometry of the input point cloud frame IPCF and may be, for example, a monochrome image of WxH pixels represented in YUV420-8 bit format.

[0069] To better handle the case where multiple 3D samples are projected (mapped) onto the same 2D sample of the projection plane (along the same projection direction (line)), multiple images, called layers, may be generated. Thus, different depth values ​​D1, ..., Dn may be associated with the 2D samples of the patch, and then multiple geometry images may be generated.

[0070] In V-PCC, the 2D samples of the patch are projected into two layers. The first layer, also called the near layer, may for example store depth values ​​D0 associated with 2D samples of a smaller depth. The second layer, called the far layer, may for example store depth values ​​D1 associated with 2D samples of a larger depth. Alternatively, the second layer may store a difference value between depth values ​​D1 and D0. For example, the information stored by the second depth image may be in the interval [0,Δ] corresponding to depth values ​​in the range [D0,D0+Δ], where Δ is a user-defined parameter describing the thickness of the surface.

[0071] In this way, the second layer may contain important high-frequency features such as contours, and therefore it may be difficult to encode the second depth image using a conventional video coder, and therefore the depth values ​​may be poorly reconstructed from the decoded second depth image, resulting in poor quality geometry in the reconstructed point cloud frame.

[0072] According to one embodiment, the geometry image generation module GIG may code (derive) depth values ​​associated with the 2D samples of the first and second layers by using the auxiliary patch information PI.

[0073] In V-PCC, the location of a 3D sample within a patch with a corresponding connected component can be expressed in terms of depth δ(u,v), tangent shift s(u,v), and bitangent shift r(u,v) as follows: δ(u,v)=δ0+g(u,v) s(u,v)=s0-u0+u r(u,v)=r0-v0+v where g(u,v) is the brightness component of the geometry image, (u,v) is the pixel associated with the 3D sample on the projection plane, (δ0,s0,r0) is the 3D position of the corresponding patch of the connected component to which the 3D sample belongs, and (u0,v0,u1,v1) are the coordinates in the projection plane that define a 2D bounding box that contains the projection of the patch associated with the connected component.

[0074] Thus, the geometry image generation module GIG may encode (derive) the depth values ​​associated with the 2D samples (first and / or second) of a layer as luminance components g(u,v) given by g(u,v)=δ(u,v)−δ0, which may be used to reconstruct the 3D sample positions (δ0,s0,r0) from the reconstructed geometry image g(u,v) with the accompanying auxiliary patch information PI.

[0075] According to one embodiment, the projection mode may be used to indicate whether the first geometry image GI0 may store depth values ​​of 2D samples of either the first or second layer, and whether the second geometry image GI1 may store depth values ​​associated with 2D samples of either the first or second layer.

[0076] For example, if the projection mode is equal to 0, the first geometry image GI0 may store depth values ​​of the 2D samples of the first layer, and the second geometry image GI1 may store depth values ​​associated with the 2D samples of the second layer. Conversely, if the projection mode is equal to 1, the first geometry image GI0 may store depth values ​​of the 2D samples of the second layer, and the second geometry image GI1 may store depth values ​​associated with the 2D samples of the first layer.

[0077] According to one embodiment, the frame projection mode may be used to indicate whether a fixed projection mode is used for all patches, or whether a variable projection mode is used, in which each patch may use a different projection mode.

[0078] The projection mode and / or the frame projection mode may be transmitted as metadata.

[0079] The frame projection mode decision algorithm may be provided, for example, in section 2.2.1.3.1 of the V-PCC.

[0080] According to one embodiment, if the frame projection indicates that a variable projection mode may be used, then the patch projection mode may be used to indicate the appropriate mode to use for (de)projecting the patch.

[0081] The patch projection mode may be transmitted as metadata and possibly may be information included in the auxiliary patch information PI.

[0082] The patch projection mode decision algorithm is provided, for example, in section 2.2.1.3.2 of the V-PCC.

[0083] According to an embodiment of step 3300, a pixel value of a first geometry image, e.g., GI0, corresponding to a 2D sample (u,v) of a patch may represent a depth value associated with at least one intermediate 3D sample defined along a projection line corresponding to said 2D sample (u,v). The intermediate 3D sample lies along the projection line and shares the same coordinate of the 2D sample (u,v) whose depth value D1 is coded in a second geometry image, e.g., GI1. Also, said intermediate 3D sample may have a depth value between depth value D0 and depth value D1. A designated bit may be associated with each of the intermediate 3D samples, set to 1 if the intermediate 3D sample exists and set to 0 otherwise.

[0084] Then, all the designated bits along the projection line can be concatenated to form a codeword, hereafter referred to as an Extended Delta Depth (EDD) code. Finally, all the EDD codes can be packed into an image, for example the first geometry image GI1 or the occupancy map OM.

[0085] In step 3400, the texture image generator TIG may generate at least one texture image TI from the geometry of the reconstructed point cloud frame derived from the input point cloud frame IPCF, the occupancy map OM, the auxiliary patch information PI, and at least one decoded geometry image DGI that is the output of the video decoder VDEC (step 4200 in FIG. 4).

[0086] The texture image TI may represent the texture of the input point cloud frame IPCF and may be, for example, an image of W×H pixels represented in YUV420-8 bit format.

[0087] The texture image generator TG may utilize the occupancy map information to detect (locate) occupied blocks and thus non-empty pixels in the texture image.

[0088] A texture image generator TIG may be adapted to generate and associate a texture image TI with each geometry image / layer DGI.

[0089] According to one embodiment, the texture image generator TIG may code (store) texture (attribute) values ​​T0 associated with the 2D samples of the first layer as pixel values ​​of a first texture image TI0 and may code (store) texture values ​​T1 associated with the 2D samples of the second layer as pixel values ​​of a second texture image TI1.

[0090] Alternatively, the texture image generation module TIG may code (store) texture values ​​T1 associated with the 2D samples of the second layer as pixel values ​​of the first texture image TI0 and code (store) texture values ​​D0 associated with the 2D samples of the first layer as pixel values ​​of the second geometry image GI1.

[0091] For example, the color of the 3D sample may be obtained as described in sections 2.2.3, 2.2.4, 2.2.5, 2.2.8, or 2.5 of the V-PCC.

[0092] According to one embodiment, a padding process may be applied to the geometry and / or texture images that can be used to fill empty spaces between patches to generate piecewise smooth images suitable for video compression.

[0093] Examples of image padding are provided in sections 2.2.6 and 2.2.7 of the V-PCC.

[0094] At step 3500, the video encoder VENC may encode the generated images / layers TI and GI.

[0095] In step 3600, the encoder OMENC may encode the occupancy map as an image, for example as detailed in section 2.2.2 of V-PCC. Lossy or lossless encoding may be used.

[0096] According to one embodiment, the video encoder ENC and / or OMENC may be a HEVC-based encoder.

[0097] In step 3700, the encoder PIENC may encode the auxiliary patch information PI and possibly additional metadata such as the block size T, width W and height H of the geometry / texture image.

[0098] According to one embodiment, the auxiliary patch information may be differentially encoded (eg, as defined in section 2.4.1 of the V-PCC).

[0099] In step 3800, a multiplexer may be applied to the generated outputs of steps 3500, 3600, and 3700 so that these outputs may be multiplexed together to generate a bitstream representing the base layer BL. Note that the metadata information represents a small portion of the overall bitstream. Most of the information is compressed using a video codec.

[0100] FIG. 4 shows a schematic block diagram of an example image-based point cloud decoder 4000 according to at least one of the present embodiments.

[0101] In step 4100, a demultiplexer DMUX may be applied to demultiplex the coded information of the bitstream representing the base layer BL.

[0102] In step 4200, the video decoder VDEC may decode the encoded information to derive at least one decoded geometry image DGI and at least one decoded texture image DTI.

[0103] In step 4300, the decoder OMDEC may decode the encoded information to derive a decoded occupancy map DOM.

[0104] According to one embodiment, the video decoder VDEC and / or OMDEC may be a HEVC-based decoder.

[0105] In step 4400, the decoder PIDEC may decode the encoded information to derive auxiliary patch information DPI.

[0106] In some cases, metadata may also be derived from the bitstream BL.

[0107] In step 4500, the geometry generation module GGM may derive a geometry RG of the reconstructed point cloud frame IRPCF from at least one decoded geometry image DGI, the decoded occupancy map DOM, the decoded auxiliary patch information DPI and possible additional metadata.

[0108] The geometry generation module GGM may utilize the decoded occupancy map information DOM to locate a non-empty pixel in at least one decoded geometry image DGI. The 3D coordinates of a reconstructed 3D sample associated with a non-empty pixel may then be derived from the coordinates of said non-empty pixel and the value of said reconstructed 2D sample.

[0109] According to one embodiment, the geometry generation module GGM may derive the 3D coordinates of the reconstructed 3D samples from the coordinates of the non-empty pixels.

[0110] According to one embodiment, the geometry generation module GGM may derive the 3D coordinates of the reconstructed 3D sample from the coordinates of the non-empty pixels, the values ​​of said non-empty pixels of one of the at least one decoded geometry image DGI, the decoded auxiliary patch information, and possibly additional metadata.

[0111] The use of non-empty pixels is based on the relationship of 2D pixels with 3D samples. For example, in the projection on the V-PCC, the 3D coordinates of the reconstructed 3D sample can be expressed in terms of depth δ(u,v), tangent shift s(u,v), and bitangent shift r(u,v) as follows: δ(u,v)=δ0+g(u,v) s(u,v)=s0-u0+u r(u,v)=r0-v0+v where g(u,v) is the luma component of the decoded geometry image DGI, (u,v) is the pixel associated with the reconstructed 3D sample, (δ0,s0,r0) is the 3D position of the connected component to which the reconstructed 3D sample belongs, and (u0,v0,u1,v1) are the coordinates in the projection plane that define the 2D bounding box that contains the projection of the patch associated with the connected component.

[0112] In step 4600, the texture generation module TGM may derive the texture of the reconstructed point cloud frame IRPCF from the geometry RG and at least one decoded texture image DTI.

[0113] FIG. 5 illustrates generally an example syntax of a bitstream representing a base layer BL according to at least one of the present embodiments.

[0114] The bitstream includes a bitstream header SH and at least one group of frame streams GOFS.

[0115] The group of a frame stream GOFS includes a header HS, at least one syntax element OMS representing an occupancy map OM, at least one syntax element GVS representing at least one geometry image (or video), at least one syntax element TVS representing at least one texture image (or video), and at least one syntax element PIS representing auxiliary patch information and other additional metadata.

[0116] In a variant, a group of frame streams GOFS comprises at least one frame stream.

[0117] FIG. 6 depicts a schematic block diagram illustrating an example of a system in which various aspects and embodiments may be implemented.

[0118] System 6000 may be embodied as one or more devices including various components described below and configured to perform one or more of the aspects described in this document. Examples of equipment that may form all or part of system 6000 include personal computers, laptops, smartphones, tablet computers, digital multimedia set-top boxes, digital television receivers, personal video recording systems, connected home appliances, connected vehicles and their associated processing systems, head-mounted display devices (HMDs, see-through glasses), projectors (beamers), "caves" (systems including multiple displays), servers, video encoders, video decoders, post-processors that process output from video decoders, pre-processors that provide input to video encoders, web servers, set-top boxes, and other devices for processing point clouds, videos, images, or other communication devices. The elements of system 6000, alone or in combination, may be embodied in a single integrated circuit, multiple ICs, and / or separate components. For example, in at least one embodiment, the processing and encoder / decoder elements of system 6000 may be distributed across multiple ICs and / or separate components. In various embodiments, the system 6000 may be communicatively coupled to other similar systems or to other electronic devices, for example, via a communication bus or through dedicated input and / or output ports. In various embodiments, the system 6000 may be configured to implement one or more of the aspects described in this document.

[0119] The system 6000 may include at least one processor 6010 configured to execute loaded instructions, for example, to implement various aspects described in this document. The processor 6010 may include embedded memory, input output interfaces, and various other circuits as known in the art. The system 6000 may include at least one memory 6020 (e.g., a volatile memory device and / or a non-volatile memory device). The system 6000 may include a storage device 6040, which may include non-volatile memory and / or volatile memory, including, but not limited to, an electrically erasable programmable read-only memory (EEPROM), a read-only memory (ROM), a programmable read-only memory (PROM), a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a flash, a magnetic disk drive, and / or an optical disk drive. The storage device 6040 may include, as non-limiting examples, an internal storage device, an attached storage device, and / or a network-accessible storage device.

[0120] The system 6000 may include an encoder / decoder module 6030 configured to process data to provide, for example, encoded or decoded data, which may include its own processor and memory. The encoder / decoder module 6030 may represent a module that may be included in a device that performs encoding and / or decoding functions. As is known, a device may include one or both of an encoding module and a decoding module. Furthermore, the encoder / decoder module 6030 may be implemented as a separate element of the system 6000 or may be incorporated within the processor 6010 as a combination of hardware and software known to those skilled in the art.

[0121] Program code to be loaded into the processor 6010 or the encoder / decoder 6030 to perform various aspects described herein may be stored in the storage device 6040 and subsequently loaded onto the memory 6020 for execution by the processor 6010. According to various embodiments, one or more of the processor 6010, the memory 6020, the storage device 6040, and the encoder / decoder module 6030 may store one or more of various items during the execution of the processes described herein. Such stored items may include, but are not limited to, point cloud frames, encoded / decoded geometry / texture videos / images or portions of encoded / decoded geometry / texture videos / images, bitstreams, matrices, variables, and intermediate or final results from the processing of equations, expressions, operations, and computational logic.

[0122] In some embodiments, memory within the processor 6010 and / or the encoder / decoder module 6030 may be used to store instructions and provide working memory for processing that may occur during encoding or decoding.

[0123] However, in other embodiments, memory external to the processing device (e.g., the processing device may be either the processor 6010 or the encoder / decoder module 6030) may be used for one or more of these functions. The external memory may be the memory 6020 and / or the storage device 6040, e.g., dynamic volatile memory and / or non-volatile flash memory. In some embodiments, the external non-volatile flash memory may be used to store the television's operating system. In at least one embodiment, a high-speed external dynamic volatile memory such as RAM may be used as working memory for video encoding and decoding operations such as MPEG-2 Part 2 (also known as ITU-T Recommendation H.262 and ISO / IEC 13818-2, also known as MPEG-2 Video), HEVC (High Efficiency Video Coding), or VVC (Versatile Video Coding).

[0124] Input to the elements of system 6000 may be provided through various input devices as shown in block 6130. Such input devices may include, but are not limited to, (i) an RF section that may receive, for example, an RF signal transmitted over the air by a broadcaster, (ii) a composite input, (iii) a USB input, and / or (iv) an HDMI input.

[0125] In various embodiments, the input devices of block 6130 may have associated respective input processing elements as known in the art. For example, the RF section may be associated with elements necessary to (i) select a desired frequency (also referred to as selecting a signal or band-limiting a signal to a frequency band), (ii) down-convert the selected signal, (iii) band-limit again to a narrower frequency band to select (for example) a signal frequency band that may be referred to as a channel in certain embodiments, (iv) demodulate the down-converted and band-limited signal, (v) perform error correction, and (vi) demultiplex to select a desired data packet stream. The RF section of various embodiments may include one or more elements that perform these functions, such as a frequency selector, a signal selector, a band limiter, a channel selector, a filter, a down-converter, a demodulator, an error corrector, and a demultiplexer. The RF section may include, for example, a tuner that performs a variety of these functions, including down-converting a received signal to a lower frequency (e.g., an intermediate frequency or a frequency close to baseband) or to baseband.

[0126] In one set-top box embodiment, the RF section and its associated input processing elements may receive an RF signal transmitted over a wired (e.g., cable) medium. The RF section may then perform frequency selection by filtering, down-converting, and re-filtering to a desired frequency band.

[0127] In various embodiments, the order of the above (and other) elements is rearranged, some of these elements are removed, and / or other elements that perform similar or different functions are added.

[0128] Adding elements may include inserting elements between existing elements, such as inserting amplifiers and analog-to-digital converters, etc. In various embodiments, the RF section may include an antenna.

[0129] Additionally, the USB and / or HDMI terminals may include respective interface processors for connecting the system 6000 to other electronic devices over USB and / or HDMI connections. It will be appreciated that various aspects of the input processing, e.g., Reed-Solomon error correction, may be implemented, for example, in a separate input processing IC or in the processor 6010, as desired. Similarly, aspects of the USB or HDMI interface processing may be implemented, for example, in a separate interface IC or in the processor 6010, as desired. For example, the demodulated, error corrected, and demultiplexed stream may be provided to various processing elements, including the processor 6010 and the encoder / decoder 6030, which operate in combination with memory and storage elements to process the data stream, as desired, for display on an output device.

[0130] The various elements of the system 6000 may be provided within a unitary housing, where the various elements may be interconnected and transmit data between them using a suitable connection arrangement 6140, e.g., an internal bus known in the art, including an I2C bus, hardwired, and printed circuit boards.

[0131] The system 6000 may include a communication interface 6050 that enables communication with other devices over a communication channel 6060. The communication interface 6050 may include, but is not limited to, a transceiver configured to transmit and receive data over the communication channel 6060. The communication interface 6050 may include, but is not limited to, a modem or a network card, and the communication channel 6060 may be implemented in a wired and / or wireless medium, for example.

[0132] In various embodiments, data may be streamed to the system 6000 using a Wi-Fi network, such as IEEE 802.11. The Wi-Fi signal in these embodiments may be received via a communication channel 6060 and communication interface 6050 adapted for Wi-Fi communication. The communication channel 6060 in these embodiments may typically be connected to an access point or router that provides access to external networks, including the Internet, enabling streaming applications and other over-the-top communications.

[0133] Other embodiments may provide streamed data to the system 6000 using a set-top box that delivers data via an HDMI connection in the input block 6130.

[0134] Yet other embodiments may use the RF connection of input block 6130 to provide streamed data to system 6000.

[0135] It should be appreciated that signaling may be accomplished in various manners, for example, one or more syntax elements, flags, etc. may be used in various embodiments to signal information to a corresponding decoder.

[0136] System 6000 may provide output signals to various output devices, including a display 6100, speakers 6110, and other peripheral devices 6120, which in various example embodiments may include one or more of a stand-alone DVR, a disc player, a stereo system, a lighting system, and other devices that provide functionality based on the output of system 3000.

[0137] In various embodiments, control signals may be communicated between the system 6000 and a display 6100, speaker 6110, or other peripheral device 6120 using signaling such as AV Link (Audio / Video Link), CEC (Consumer Electronics Control), or other communication protocols that enable inter-device control with or without user intervention.

[0138] Output devices may be communicatively coupled to the system 6000 via dedicated connections through respective interfaces 6070, 6080, and 6090.

[0139] Alternatively, output devices may be connected to the system 6000 using a communication channel 6060 via the communication interface 6050. The display 6100 and speakers 6110 may be integrated into a single unit with other components of the system 6000 in an electronic device such as a television.

[0140] In various embodiments, the display interface 6070 may include a display driver, such as, for example, a timing controller (T Con) chip.

[0141] The display 6100 and speakers 6110 may alternatively be separate from one or more of the other components, for example, if the RF portion of the input 6130 is part of a separate set-top box. In various embodiments in which the display 6100 and speakers 6110 may be external components, they may provide output signals via dedicated output connections, including, for example, an HDMI port, a USB port, or a COMP output.

[0142] PLR stands for Point Local Reconstruction. PLR is a reconstruction method that can be used to generate additional 3D samples in a point cloud frame. PLR is typically applied immediately after 2D to 3D projection, before other processing such as geometry or texture smoothing.

[0143] PLR takes a layer of 3D samples as input and applies a series of filters driven by PLR metadata to generate additional 3D samples containing geometry and textures.

[0144] Since the PLR ​​metadata may be changed for every T×T block of the canvas, and a set of filters may generate additional 3D samples using a small neighborhood, the PLR ​​may be localized. Note that the same PLR ​​metadata must be used in the encoder and decoder.

[0145] In typical conditions, using one layer of depth and texture images in PLR results in better BD-rate performance than using two layers of depth and texture images. The coding of PLR metadata requires fewer bits than traditional coding of 3D samples by projecting them onto the depth and texture images, resulting in a lower overall bitrate. At the same time, the additional 3D samples compensate for the loss of quality that occurs due to using fewer layers.

[0146] V-PCC includes an implementation of PLR, which is determined by rate-distortion optimization (RDO) at the encoder side, and defines several modes, called PLRMs (point local reconstruction modes), to reconstruct (generate) at least one 3D sample of a point cloud frame. Each PLRM is determined by a specific value of the PLRM metadata that defines how to use the filters.

[0147] For example, in V-PCC section "9.4.4", multiple PLRMs are determined by four parameters described in V-PCC section "7.4.35 Point Local Reconstruction Semantics", which are transmitted as PLRM metadata in the bitstream below. ●point_local_reconstruction_mode_interpolate_flag: This parameter is equal to 1, indicating that point-to-point interpolation is used during the reconstruction method; this parameter is equal to 0, indicating that point-to-point interpolation is not used during the reconstruction method. ●point_local_reconstruction_mode_filling_flag This parameter is equal to 1, indicating that the fill mode is used during the reconstruction method, and this parameter is equal to 0, indicating that the fill mode is not used during the reconstruction process. ●point_local_reconstruction_mode_minimum_depth_minus1: This parameter specifies the minimum depth value minus one to use during the reconstruction method. ●point_local_reconstruction_mode_neighbour_minus1: This parameter specifies the size of the 2D neighborhood used in the reconstruction method, minus one.

[0148] The syntax for coding PLR is detailed in section "7.3.4.1" of V-PCC defined in document w18479. This syntax describes the PLRM metadata transmitted via "blockToPatch" information or by patch by TxT blocks (occupied packing block size). The blockToPatch structure indicates for each block of TxT pixels the patch to which it belongs. The block-to-patch block size of 16x16 pixels is a typical value used in the model software of V-PCC test. The specification (and at least one of the present embodiments) may support other block sizes for block-to-patch index and PLRM metadata.

[0149] According to this principle, the encoder is capable of generating several layers with associated PLR modes. The concept of layers allows to capture all these 3D points efficiently, and the PLR ​​method allows to reduce the bitrate required to code such projections. The current test model supports up to two layers. Adding the possibility to use PLR ​​in two-layer mode improves the compression efficiency of the point cloud and allows the reconstructed point cloud to be more faithful to the original point cloud.

[0150] There is no syntax and method for encoding and decoding multiple layers, regardless of whether the layers have PLR ​​metadata associated with them. There is no signaling method for associating PLR information and / or modes with different layered images. Modifying the existing syntax, for example as described in document w18479 of the V-PCC standard, is not straightforward, since any modification implies a system-wide adaptation. Furthermore, adding PLR information and modes to all layers in a loose manner without considering their use would overload the bitrate. Thus, there is a lack of solutions for encoding, signaling, transmitting, and decoding 3D point clouds using PLR methods efficiently at different layers of a projection, according to different embodiments. Such a solution is proposed in connection with Figs. 7 and 8.

[0151] To change PLR ​​to an arbitrary number of layers, the actual 1-layer mode needs to be changed to each layer in the multi-layer mode. A few extensions are required: ●PLR per-block / per-patch parameters are available for each layer. • PLR information is available for each layer. • PLR reconstruction is performed layer by layer.

[0152] It is understood that the PLR ​​information refers to a PLR lookup table of processing modes as well as other high-level PLR parameters. The PLR ​​information is coded in the point_local_reconstruction_information syntax structure. Depending on how the PLR ​​metadata is transmitted, several embodiments are possible, for example: Each layer has its PLR information and per-block / per-patch mode. ●Multiple layers share the same PLR ​​information, but per-block / per-patch modes are provided per layer. ● Share PLR ​​information and Share PLR ​​mode.

[0153] For clarity, in Figures 7 to xxx the syntax is shown relative to the current V-PCC syntax (available in document w18479).

[0154] FIG. 7 diagrammatically illustrates a method 700 for decoding a 3D point cloud according to the present principles. In step 710, a data stream encoded according to the present principles is obtained from a source. The data stream includes data representing a 3D point cloud encoded in a layered image. In step 720, a layer is decoded from the stream. The layer image is associated with metadata including at least a PLR flag indicating whether this layer needs to be decoded according to a PLR method. The metadata associated with this layer is decoded from the stream. They may have been decoded at different times and / or from different positions in the data stream. In step 730, a test is performed to check whether the PLR ​​flag is enabled (e.g., a flag set to 1 is enabled). If the PLR ​​flag is disabled, the layer is deprojected using a conventional method. Otherwise, if the PLR ​​flag is enabled, i.e. a PLR method is applied to this layer, the PLR ​​information and mode of this layer needs to be obtained. In step 740, a test is performed to check whether the metadata includes an index pointing to PLR information associated with another layer. If not, in step 741 the PLR ​​information is retrieved from the metadata and stored in memory together with an index allowing it to be retrieved. If a PLR information index is provided in the metadata of the current layer, in step 742 the PLR ​​information is retrieved from memory by this index. In step 750 a test is performed to check whether a PLR mode index is provided in the metadata. Step 750 can occur before, after or in parallel with step 740. If a PLR mode index is not provided, in step 751 the PLR ​​modes of the current layer are retrieved from the metadata and stored in memory together with an index allowing them to be retrieved. If a PLR mode index is provided in the metadata of the current layer, in step 752 the PLR ​​modes are retrieved from memory by this index.In step 760, the layer is deprojected using the PLR ​​method by applying the obtained mode to the pixels of the layer according to the obtained PLR information.

[0155] FIG. 8 diagrammatically shows a method 800 for encoding a 3D point cloud according to the present principles. In step 810, a layer is obtained and encoded in the data stream. In a subsequent step, metadata associated with this current layer are encoded in the data stream. These metadata may be encoded in time and in the data stream before or after the layer. In step 820, a PLR flag is encoded in the metadata indicating whether the layer needs to be decoded according to a PLR method. If the PLR ​​flag is enabled (e.g., a flag set to 1 is enabled), a test is performed in step 840 to check whether the PLR ​​information of the current layer is already encoded (or will be encoded) in the metadata associated with another layer. If not, in step 841, the PLR ​​information of the current layer is encoded in the metadata associated with this current layer. Otherwise, in step 842, an index is encoded that allows to obtain the PLR ​​information of another layer. In step 850, a test is performed to check whether the PLR ​​mode of the current layer is already encoded (or will be encoded) in the metadata associated with another layer. Step 850 may be performed before, after or in parallel with step 840. If the PLR ​​mode is not shared with another layer, step 851 encodes the PLR ​​mode of the current layer in the metadata associated with this current layer. Otherwise, step 852 encodes an index that allows to obtain the PLR ​​mode of another layer.

[0156] The following discussion details proposed changes to the syntax described in the current V-PCC specification (w18479).

[0157] In one embodiment, each layer has its PLR information and PLR per-block / per-patch mode. In this embodiment, the PLR ​​parameters are optimized for each layer.

[0158] Syntax level of sequence parameter sets (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" 7.3.4.1 of the RFC 2448 standard), adding the possibility to enable the PLR ​​process per layer, as follows: [Table 1]

[0159] sps_point_local_reconstruction_layer_enabled_flag[layer], when set to 1, indicates that local reconstruction mode may be used during the point cloud reconstruction process at the corresponding layer index. sps_point_local_reconstruction_layer_enabled_flag[layer], when set to 0, indicates that local reconstruction mode should not be used during the point cloud reconstruction process at the corresponding layer index.

[0160] Patch sequence parameter set syntax level (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" 7.3.5.3 paragraph of RFC 2548 adds the possibility to define PLR ​​information per layer, as follows: [Table 2]

[0161] The point_local_reconstruction_information(layer) syntax method has been modified so that the parameters are stored in the index "layer" of the point local reconstruction information array. The modified method is shown in the section "Error! Reference source not found".

[0162] Patch Data Unit Syntax (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178"Paragraph 7.3.6.3 of this Act) is amended to read as follows: [Table 3]

[0163] Delta patch data unit syntax (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" Paragraph 7.3.6.4 of the preceding paragraph is amended to read as follows: [Table 4]

[0164] The modified point local reconstruction syntax (paragraph 7.3.6.6 of w18479) is modified to store all data in a two-dimensional array (layer identifier and patch index). The proposed version is as follows: [Table 5]

[0165] The following changes need to be applied to the rebuild process (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" (as explained in paragraph 9.4.4 of this document). [Table 6]

[0166] In another embodiment, several layers share the same PLR ​​information. The per-block / per-patch mode of PLR is still provided per layer. This embodiment allows to reduce the bitrate required to transmit the PLR ​​information at the expense of using the same set of several modes (eventually all layers, which may slightly reduce the visual quality of the decoded point cloud). One or several sets of PLR information are transmitted. The number of sets of PLR information may be less than the number of layers, so an index indicates which set of PLR information is used for each layer.

[0167] Syntax level of sequence parameter sets (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" 7.3.4.1 of the RFC 2448 standard), adding the possibility to enable the PLR ​​process per layer, as follows: [Table 7]

[0168] sps_point_local_reconstruction_information_num_sets_minus1 plus 1 indicates the number of sets of PLR information parameters to be sent. The minimum is 1 and the maximum is the number of layers. The only change from the current specification text is the use of an array (indexed by id) to store the PLR ​​information. [Table 8]

[0169] Patch sequence parameter set syntax level (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" 7.3.5.3 paragraph of RFC 2516 ... [Table 9]

[0170] The psps_point_local_reconstruction_information_set_id[layer] parameter indicates the index of the PLR ​​information set that corresponds to the layer with index "layer". The following changes need to be applied to the reconstruction process (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" (as explained in paragraph 9.4.4 of this document). [Table 10]

[0171] In another embodiment, the PLR ​​information and shared block / patch mode are shared between multiple layers, which further reduces the bitrate by transmitting less metadata, at the expense of a slight decrease in visual quality and / or a slight increase in complexity.

[0172] The next section details proposed changes to the above embodiment as well as proposed changes to the current V-PCC specification (w18479).

[0173] sps_point_local_reconstruction_information_num_sets_minus1 plus 1 indicates the number of sets of PLR information parameters to be sent. The minimum is 1, the maximum is the number of layers. The only change from the current specification text is the use of an additional array (indexed by id) to store the PLR ​​information. Patch sequence parameter set syntax level (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" 7.3.5.3 of the same Act), adding the possibility to indicate an identifier corresponding to the PLR ​​information.

[0174] Patch Data Unit Syntax (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" Paragraph 7.3.6.3 of this Act) is amended to read as follows: [Table 11]

[0175] The pdu_point_local_reconstruction_data_num_sets_minus1 parameter indicates the number of versions of PLR data available for each patch. The pdu_point_local_reconstruction_data_set_id[patchIndex][layer] parameter indicates the PLR ​​dataset identifier for obtaining the PLR ​​data of the patch "patchIndex" and layer "layer".

[0176] Delta patch data unit syntax (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" Paragraph 7.3.6.4 of the preceding paragraph is amended to read as follows: [Table 12]

[0177] The following changes need to be applied to the rebuild process (w18479 :hyperlink "https: / / wg11.sc29.org / doc_end_user / current_document.php?id=68044&id_meeting=178" (as explained in paragraph 9.4.4 of this document). [Table 13]

[0178] In the variant, the patch data unit and the delta patch data unit are simplified compared to the current embodiment as follows, since only PLR data needs to be obtained at the patch level: [Table 14] [Table 15] [Table 16]

[0179] pfps_point_local_reconstruction_data_num_sets_minus1 indicates the number of sets of PLR data.

[0180] pfps_point_local_reconstruction_data_set_id indicates which set of PLR data should be used among the pfps_point_local_reconstruction_data_num_sets_minus1 possible versions.

[0181] Another variation of the same embodiment achieves higher bitrate reduction by transmitting the set identifier of the PLR ​​data only once per sequence and per layer, where the term "sequence" is used in the same sense as in the HEVC standard.

[0182] The patch data unit and delta patch data unit are simplified compared to the current embodiment as only PLR data needs to be obtained at the patch level: [Table 17] [Table 18] [Table 19]

[0183] psps_point_local_reconstruction_data_num_sets_minus1 defines the number of sets of PLR data.

[0184] psps_point_local_reconstruction_data_set_id indicates the set of PLR data to use among the possible versions of psps_point_local_reconstruction_data_num_sets_minus1 plus 1.

[0185] The changes in the rebuild process are as follows: The pdu_point_local_reconstruction_data_set_id[f][p][l] of E3 is initialized as follows: For E3.V1, pfps_point_local_reconstruction_data_set_id[f][l], i.e. for a given frame, all patches use the same set ID. For E3.V2, psps_point_local_reconstruction_data_set_id[l], i.e., all patches use the same set ID in all frames. Where: ●f corresponds to the frame index. ●p corresponds to the patch index. ●l corresponds to the layer index.

[0186] Compared with the current embodiment, the number of sets of PLR data is shown as follows: Frame level using pfps_point_local_reconstruction_data_num_sets_minus1 (for E3.V1) ● Or at the sequence level using psps_point_local_reconstruction_data_num_sets_minus1 (for E3.V2).

[0187] Some examples are described with reference to block diagrams and operational flow charts. Each block represents a circuit element, module, or portion of code that includes one or more executable instructions for implementing a specified logical function. It should also be noted that in other implementations, the functions described in the blocks may occur in a different order than the order described. For example, two blocks shown in succession may in fact be executed substantially simultaneously, or the blocks may sometimes be executed in the reverse order, depending on the functionality involved.

[0188] The implementations and aspects described herein may be implemented, for example, in a method or process, an apparatus, a software program, a data stream, a bit stream, or a signal. Even if discussed only in the context of a single implementation (e.g., discussed only as a method), the implementation of the features discussed may also be implemented in other forms (e.g., an apparatus or program).

[0189] The method may be implemented in, for example, a processor, which generally refers to a processing device including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. Processors also include communications devices.

[0190] In addition, the method may be implemented by instructions executed by a processor, and such instructions (and / or data values ​​produced by the implementation) may be stored in a computer-readable storage medium. The computer-readable storage medium may take the form of a computer-readable program product embodied in one or more computer-readable media and having computer-executable computer-readable program code embodied thereon. As used herein, a computer-readable storage medium is considered to be a non-transitory storage medium given the inherent capability of storing information thereon, as well as the inherent capability of providing for the retrieval of information therefrom. The computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. The following provides more specific examples of computer-readable storage media to which the present embodiment may be applied, but it should be understood that a portable computer diskette, a hard disk, a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or a suitable combination of any of the foregoing, is merely an illustrative and not an exhaustive list, as would be readily understood by one of ordinary skill in the art.

[0191] The instructions may form an application program tangibly embodied on a processor-readable medium.

[0192] The instructions may be implemented, for example, in hardware, firmware, software, or a combination. The instructions may be found, for example, in an operating system, a separate application, or a combination of the two. Thus, a processor may be characterized, for example, as both a device configured to perform a process and a device that includes a processor-readable medium (such as a storage device) having instructions for performing a process. Furthermore, a processor-readable medium may store data values ​​generated by an implementation in addition to or in lieu of instructions.

[0193] The devices can be implemented, for example, with appropriate hardware, software, and firmware. Examples of such devices include personal computers, laptops, smartphones, tablet computers, digital multimedia set-top boxes, digital television receivers, personal video recording systems, connected home appliances, head-mounted display devices (HMDs, see-through glasses), projectors (beamers), "caves" (systems including multiple displays), servers, video encoders, video decoders, post-processors that process the output from the video decoders, pre-processors that provide input to the video encoders, web servers, set-top boxes, and other devices for processing point clouds, videos, images, or other communication devices. As should be clear, the equipment can be portable, even mounted on moving vehicles.

[0194] The computer software may be implemented by the processor 6010, or by hardware, or by a combination of hardware and software. As a non-limiting example, the embodiment may be implemented by one or more integrated circuits. The memory 6020 may be of any type suitable for the technical environment, and may be implemented using any suitable data storage technology, such as, as non-limiting examples, optical memory devices, magnetic memory devices, semiconductor-based memory devices, fixed memories, and removable memories. The processor 6010 may be of any type suitable for the technical environment, and may include, as non-limiting examples, one or more of a microprocessor, a general-purpose computer, a special-purpose computer, and a processor based on a multi-core architecture.

[0195] As will be apparent to one of ordinary skill in the art, implementations can generate a wide variety of signals formatted to carry information that can be, for example, stored or transmitted. Information can include, for example, instructions to perform a method or data generated by one of the described implementations. For example, a signal can be formatted to carry a bit stream of the described embodiments. Such a signal can be formatted, for example, as an electromagnetic wave (e.g., using a radio frequency portion of the spectrum) or as a baseband signal. Formatting can include, for example, encoding a data stream and modulating a carrier wave with the encoded data stream. The information that the signal carries can be, for example, analog or digital information. The signal can be transmitted over a wide variety of different wired or wireless links, as is known. The signal can be stored in a processor-readable medium.

[0196] The terms used herein are for the purpose of describing particular embodiments only and are not intended to limit the disclosure. As used herein, the singular forms "a," "an," and "the" are intended to include the plural unless the context clearly dictates otherwise. It will be further understood that as used herein, the terms "comprises" and / or "comprising" may specify the presence of stated, e.g., features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. Furthermore, when an element is referred to as "responsive to" or "connected" to another element, it may be directly responsive or connected to the other element, or intervening elements may be present. In contrast, when an element is referred to as "directly responsive to" or "directly connected" to another element, there are no intervening elements.

[0197] For example, it should be understood that the use of any of "A / B," "A and / or B," and "at least one of A and B" is intended to cover the selection of only the first listed alternative (A), or the selection of only the second listed alternative (B), or the selection of both alternatives (A and B). As a further example, in the case of "A, B, and / or C" and "at least one of A, B, and C," such language is intended to cover the selection of only the first listed alternative (A), or the selection of only the second listed alternative (B), or the selection of only the third listed alternative (C), or the selection of only the first and second listed alternatives (A and B), or the selection of only the first and third listed alternatives (A and C), or the selection of only the second and third listed alternatives (B and C), or the selection of all three alternatives (A and B and C). This can be expanded to include as many items as would be apparent to one skilled in the art.

[0198] Various numerical values ​​may be used in this application, the specific values ​​are for illustrative purposes and the described aspects are not limited to these specific values.

[0199] In this specification, the terms first, second, etc. may be used to describe various elements, but it is understood that these elements should not be limited by these terms. These terms are used only to distinguish one element from another element. For example, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element, without departing from the teachings of this application. There is no ordering implication between a first element and a second element.

[0200] References to "an embodiment" or "one embodiment" or "an implementation" or "one implementation," as well as other variations thereof, are frequently used to convey that a particular feature, structure, characteristic, etc. (described in connection with the embodiment / implementation) is included in at least one embodiment / implementation. Thus, appearances of the phrases "in one embodiment" or "in an embodiment" or "in one implementation" or "in an implementation" in various places throughout this application, as well as any other variations, are not necessarily all referring to the same embodiment.

[0201] Similarly, references herein to "according to an embodiment / example / implementation" or "in an embodiment / example / implementation," as well as other variations thereof, are frequently used to convey that a particular feature, structure, or characteristic (described in connection with an embodiment / example / implementation) may be included in at least one embodiment / example / implementation. The appearances of the phrases "according to an embodiment / example / implementation" or "in an embodiment / example / implementation" in various places throughout this specification are not necessarily all referring to the same embodiment / example / implementation, nor are separate or alternative embodiments / examples / implementations necessarily mutually exclusive of other embodiments / examples / implementations.

[0202] Reference numerals appearing in the claims are by way of example only and shall have no limiting effect on the scope of the claims. Although not explicitly described, the embodiments / examples and variations may be used in any combination or subcombination.

[0203] Where a diagram is presented as a flow diagram, it should be understood that it also provides a block diagram of the corresponding apparatus. Similarly, where a diagram is presented as a block diagram, it should be understood that it also provides a flow diagram of the corresponding method / process.

[0204] Some diagrams include arrows on communication paths to indicate a primary direction of communication, however, it should be understood that communication may occur in a direction opposite to that depicted arrow.

[0205] Various implementations involve decoding. "Decoding" as used in this application may encompass all or part of the processes performed on, for example, received point cloud frames (including possibly a received bitstream that encodes one or more point cloud frames) to generate a final output suitable for display or further processing in the reconstructed point cloud domain. In various embodiments, such processes include one or more of the processes typically performed by an image-based encoder.

[0206] As a further example, in one embodiment, "decoding" may refer only to entropy decoding, in another embodiment, "decoding" may refer only to differential decoding, and in another embodiment, "decoding" may refer to a combination of entropy and differential decoding. Whether the phrase "decoding process" may be intended to refer specifically to a subset of operations or to the broader decoding process in general will be clear based on the context of a particular description and will be well understood by one of ordinary skill in the art.

[0207] Various implementations involve encoding. Similar to the above discussion regarding "decoding," "encoding" as used in this application may encompass all or part of the processes performed on an input point cloud frame to generate, for example, an encoded bitstream. In various embodiments, such processes include one or more of the processes typically performed by an image-based encoder.

[0208] As a further example, in one embodiment, "encoding" may refer only to entropy encoding, in another embodiment, "encoding" may refer only to differential encoding, and in another embodiment, "encoding" may refer to a combination of differential and entropy encoding. Whether the phrase "encoding process" is intended to refer specifically to a subset of operations or to the broader encoding process in general will be clear based on the context of the specific description and will be well understood by one of ordinary skill in the art.

[0209] It should be noted that the syntax elements used in this specification, for example the flag point_local_reconstruction_mode_present_flag, are descriptive terms and therefore do not exclude the use of other syntax element names.

[0210] Various embodiments refer to rate-distortion optimization. In particular, during the encoding process, a balance or trade-off between rate and distortion is usually considered, often given computational complexity constraints. Rate-distortion optimization may be formulated to minimize a rate-distortion function, which is usually a weighted sum of rate and distortion. There are different approaches to solving the rate-distortion optimization problem. For example, an approach may be based on an extensive test of all encoding options, including all modes or coding parameter values ​​considered, with a full evaluation of the coding cost and associated distortion of the reconstructed signal after coding and decoding. In particular, faster approaches may be used to reduce the coding complexity by calculating approximate distortion based on a prediction or prediction residual signal rather than a reconstructed signal. These two approaches may also be used in combination, such as by using approximate distortion for only some of the possible encoding options and full distortion for others. Other approaches evaluate only a subset of the possible encoding options. More generally, many approaches employ any of a variety of techniques to perform the optimization, but the optimization is not necessarily a full evaluation of both the coding cost and the associated distortion.

[0211] Additionally, the application may refer to "determining" various portions of information. Determining the information may include, for example, one or more of estimating the information, calculating the information, predicting the information, or retrieving the information from a memory.

[0212] Additionally, the application may refer to "accessing" various portions of information. Accessing information may include, for example, one or more of receiving information, retrieving information (e.g., from a memory), storing information, moving information, copying information, calculating information, determining information, predicting information, or inferring information.

[0213] Additionally, the application may refer to "receiving" various portions of information. Receiving, like "accessing," is intended to be a broad term. Receiving information may include, for example, one or more of accessing information or retrieving information (e.g., from a memory). Additionally, "receiving" typically involves in some manner, for example, an operation such as storing information, processing information, transmitting information, moving information, copying information, erasing information, calculating information, judging information, predicting information, or evaluating information.

[0214] Also, as used herein, the word "signaling" refers to, among other things, indicating something to a corresponding decoder. For example, in certain embodiments, an encoder signals a specific syntax element SE and / or PLR metadata. In this way, in embodiments, the same parameters (PLR metadata) can be used at both the encoder side and the decoder side. Thus, for example, an encoder can transmit a specific parameter to a decoder (explicit signaling), so that the decoder can use the same specific parameter. Conversely, if the decoder already has a specific parameter as well as other parameters, signaling can be used without transmission (implicit signaling) to allow the decoder to easily recognize and select the specific parameter. By avoiding the transmission of any actual features, bit savings are realized in various embodiments. It should be appreciated that signaling can be achieved in various manners. For example, one or more syntax elements, flags, etc. are used in various embodiments to signal information to a corresponding decoder. Although the above is directed to the verb form of the word "signaling", the word "signaling" can also be used herein as a noun.

[0215] A number of implementations have been described. Nevertheless, it will be understood that various modifications can be made. For example, elements of different implementations can be combined, supplemented, modified, or removed to produce other implementations. Also, those skilled in the art will understand that other structures and processes can be substituted for those disclosed, with the resulting implementations performing at least substantially the same functions, in at least substantially the same ways, to achieve at least substantially the same results as the disclosed implementations. Accordingly, these and other implementations are contemplated by the present application.

Claims

1. 1. A method for decoding a 3D point cloud, comprising: - decoding a first layered image and associated first metadata from a data stream, the first metadata including first information indicating whether the first layered image is decoded according to a point local reconstruction method; - on condition that said first information is valid, Obtaining first point local reconstruction information and a first point local reconstruction mode in the first metadata; applying the first point local reconstruction mode to the first layered image according to the first point local reconstruction information to reconstruct the 3D point cloud; - decoding a second layered image and associated second metadata from the data stream, the second metadata including second information indicating whether the second layered image is decoded according to a point local reconstruction method and an index of the first point local reconstruction information; - on condition that said second information is valid, Obtaining a second point local reconstruction mode in the second metadata; and and applying the second point local reconstruction mode to the second layered image according to the first point local reconstruction information to reconstruct the 3D point cloud.

2. - decoding a third layered image and associated third metadata from the data stream, the third metadata including third information indicating whether the third layered image is decoded according to a point local reconstruction method and an index indicating the first or second point local reconstruction mode; - on condition that the third information is valid, Obtaining third point local reconstruction information in the third metadata; and 2. The method of claim 1, further comprising: applying the first or the second point local reconstruction mode to the third layered image according to the third point local reconstruction information to reconstruct the 3D point cloud.

3. - decoding a fourth layered image and associated fourth metadata from the data stream, the fourth metadata including fourth information indicating whether the fourth layered image is decoded according to a point local reconstruction method, an index of the first or the third point local reconstruction information, and an index indicating the first or the second or the third point local reconstruction mode; - on condition that the fourth information is valid, 3. The method of claim 2, further comprising: applying the first, second or third point local reconstruction mode to the fourth layered image according to the first or third point local reconstruction information to reconstruct the 3D point cloud.

4. 1. A device for decoding a 3D point cloud, comprising: - decoding a first layered image and associated first metadata from a data stream, the first metadata including first information indicating whether the first layered image is decoded according to a point local reconstruction method; - on condition that said first information is valid, Obtaining first point local reconstruction information and a first point local reconstruction mode in the first metadata; applying the first point local reconstruction mode to the first layered image according to the first point local reconstruction information to reconstruct the 3D point cloud; - decoding a second layered image and associated second metadata from the data stream, the second metadata including second information indicating whether the second layered image is decoded according to a point local reconstruction method and an index of the first point local reconstruction information; - on condition that said second information is valid, Obtaining a second point local reconstruction mode in the second metadata; and and applying the second point local reconstruction mode to the second layered image according to the first point local reconstruction information to reconstruct the 3D point cloud.

5. The processor, - decoding a third layered image and associated third metadata from the data stream, the third metadata including third information indicating whether the third layered image is decoded according to a point local reconstruction method and an index indicating the first or second point local reconstruction mode; - on condition that the third information is valid, Obtaining third point local reconstruction information in the third metadata; and 5. The device of claim 4, further configured to: apply the first or the second point local reconstruction mode to the third layered image according to the third point local reconstruction information to reconstruct the 3D point cloud.

6. The processor, - decoding a fourth layered image and associated fourth metadata from the data stream, the fourth metadata including fourth information indicating whether the fourth layered image is decoded according to a point local reconstruction method, an index of the first or the third point local reconstruction information, and an index indicating the first or the second or the third point local reconstruction mode; - on condition that the fourth information is valid, 6. The device of claim 5, further configured to: apply the first, second or third point local reconstruction mode to the fourth layered image according to the first or third point local reconstruction information to reconstruct the 3D point cloud.

7. 1. A method for encoding a 3D point cloud, comprising: - encoding a first layered image and associated first metadata in a data stream, said first metadata comprising: first information indicating whether the first layered image is decoded according to a point local reconstruction method; including first point local reconstruction information and a first point local reconstruction mode, on condition that the first information is enabled; and encoding a second layered image and associated second metadata in said data stream, said second metadata comprising: second information indicating whether the second layered image is decoded according to a point local reconstruction method; an index of the first point local reconstruction information; and a second point local reconstruction mode, on condition that the second information is valid.

8. encoding a third layered image and associated third metadata in said data stream, said third metadata comprising: third information indicating whether the third layered image is decoded according to a point local reconstruction method; an index indicating the first or second point local reconstruction mode; The method of claim 7 , further comprising: a third point local reconstruction information, on the condition that the third information is valid.

9. encoding a fourth layered image and associated fourth metadata in said data stream, said fourth metadata comprising: fourth information indicating whether the fourth layered image is decoded according to a point local reconstruction method; an index of the first or third point local reconstruction information; and an index indicating the first, or the second, or the third point local reconstruction mode.

10. 1. A device for encoding a 3D point cloud, comprising: - encoding a first layered image and associated first metadata in a data stream, said first metadata comprising: first information indicating whether the first layered image is decoded according to a point local reconstruction method; including first point local reconstruction information and a first point local reconstruction mode, on the condition that the first information is valid; encoding a second layered image and associated second metadata in said data stream, said second metadata comprising: second information indicating whether the second layered image is decoded according to a point local reconstruction method; an index of the first point local reconstruction information; and a second point local reconstruction mode, if the second information is valid.

11. The processor, encoding a third layered image and associated third metadata in said data stream, said third metadata comprising: third information indicating whether the third layered image is decoded according to a point local reconstruction method; an index indicating the first or second point local reconstruction mode; and third point local reconstruction information, on the condition that the third information is valid.

12. The processor, encoding a fourth layered image and associated fourth metadata in said data stream, said fourth metadata comprising: fourth information indicating whether the fourth layered image is decoded according to a point local reconstruction method; an index of the first or third point local reconstruction information; and an index indicating the first, second, or third point local reconstruction mode.

13. A non-transitory computer readable medium comprising instructions which, when executed by a computer, cause the computer to perform the method of any one of claims 1 to 3.

14. A non-transitory computer readable medium comprising instructions which, when executed by a computer, cause the computer to perform the method of any one of claims 7 to 9.

Citation Information

Patent Citations

  • High-level syntax design for point cloud coding

    JP2021528917A

  • High-level syntax designs for point cloud coding

    WO2020005365A1