Information encoding method, decoding method, apparatus, and related device

Abstract

The application discloses an information coding method, a decoding method device and related equipment, and belongs to the technical field of computers. The information coding method of the application comprises the following steps: an encoding end writes mesh stitching information into a first unit, wherein the mesh stitching information is used for stitching sub-meshes of a three-dimensional mesh; and the encoding end encodes the first unit to obtain a code stream.

Description

Technical Field

[0001] This application belongs to the field of computer technology, specifically relating to an information encoding method, a decoding method apparatus, and related equipment. Background Technology

[0002] Three-dimensional models have emerged as a new generation of digital media following audio, images, and video. Among them, 3D meshes are a commonly used method for representing 3D models. Compared to traditional multimedia such as images and videos, 3D meshes offer stronger interactivity and realism, leading to their increasingly widespread application in various fields such as commerce, manufacturing, construction, education, medicine, entertainment, art, and the military. However, in some related technologies, during the encoding and decoding process of 3D meshes, the encoding end only encodes the information contained within the 3D mesh, namely geometric information, connectivity information, and attribute information. The decoding end then obtains the geometric information, connectivity information, and attribute information through the bitstream. Therefore, the encoding performance is relatively poor. Summary of the Invention

[0003] This application provides an information encoding method, a decoding method apparatus, and related equipment, which can solve the problem of poor encoding performance.

[0004] Firstly, an information encoding method is provided, including:

[0005] The encoding end writes mesh stitching information into the first unit, and the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh;

[0006] The encoding end encodes the first unit to obtain a bitstream.

[0007] Secondly, an information decoding method is provided, including:

[0008] The decoding end parses the bitstream to obtain the first unit, which includes mesh stitching information. The mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh.

[0009] The processing module is also used to stitch the sub-mesh of the three-dimensional mesh according to the mesh stitching information.

[0010] Thirdly, an information encoding device is provided, comprising:

[0011] The processing module is used to write mesh stitching information into the first unit, wherein the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh;

[0012] The processing module is also used to encode the first unit to obtain a bitstream.

[0013] Fourthly, an information decoding device is provided, comprising:

[0014] The processing module is used to parse the bitstream to obtain a first unit, the first unit including mesh stitching information, which is used to stitch the sub-mesh of the three-dimensional mesh;

[0015] The decoding end stitches the sub-mesh of the three-dimensional mesh according to the mesh stitching information.

[0016] Fifthly, an information encoding apparatus is provided, the apparatus being configured to perform the steps of the method described in the first aspect.

[0017] In a sixth aspect, an information decoding apparatus is provided, the apparatus being configured to perform the steps of the method described in the second aspect.

[0018] In a seventh aspect, an electronic device is provided, the terminal including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method as described in the first aspect, or the program or instructions, when executed by the processor, implementing the steps of the method as described in the second aspect.

[0019] Eighthly, an electronic device is provided, including a processor and a communication interface, wherein the processor is used to write mesh stitching information into a first unit, the mesh stitching information being used to stitch sub-mesh of a three-dimensional mesh; and the first unit is encoded to obtain a bitstream.

[0020] In a ninth aspect, an electronic device is provided, including a processor and a communication interface, wherein the processor is used to parse a bitstream to obtain a first unit, the first unit including mesh stitching information, the mesh stitching information being used to stitch sub-mesh of a three-dimensional mesh; and stitching sub-mesh of the three-dimensional mesh according to the mesh stitching information.

[0021] In a tenth aspect, an electronic device is provided, comprising: a memory configured to store video data, and processing circuitry configured to implement the steps of the method described in the first aspect.

[0022] Eleventhly, an electronic device is provided, comprising: a memory configured to store video data, and processing circuitry configured to implement the steps of the method described in the second aspect.

[0023] In a twelfth aspect, a readable storage medium is provided, on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method as described in the first aspect, or the program or instructions, when executed by a processor, implement the steps of the method as described in the second aspect.

[0024] In a thirteenth aspect, a chip is provided, the chip including a processor and a communication interface coupled to the processor, the processor being configured to run a program or instructions to implement the steps of the method described in the first aspect, or to implement the steps of the method described in the first aspect.

[0025] In a fourteenth aspect, a computer program / program product is provided, which is stored in a storage medium and is executed by at least one processor to perform the steps of the method as described in the first aspect, or the computer program / program product is executed by at least one processor to perform the steps of the method as described in the first aspect.

[0026] In this embodiment, the encoding end writes mesh stitching information into a first unit, which is used to stitch sub-mesh of a 3D mesh; the encoding end encodes the first unit to obtain a bitstream. Encoding the mesh stitching information improves encoding performance, and the mesh stitching information also enables the decoding end to support stitching sub-mesh of the 3D mesh, thereby improving decoding performance. Attached Figure Description

[0027] Figure 1 This is a flowchart of an information encoding method provided in an embodiment of this application;

[0028] Figure 2 This is a flowchart of an information decoding method provided in an embodiment of this application;

[0029] Figure 3 This is a schematic diagram of an encoding provided in an embodiment of this application;

[0030] Figure 4 This is a schematic diagram of an encoding provided in an embodiment of this application;

[0031] Figure 5 This is a schematic diagram of an information encoding device provided in an embodiment of this application;

[0032] Figure 6 This is a schematic diagram of an information decoding device provided in an embodiment of this application;

[0033] Figure 7 This is a schematic diagram of a communication device provided in an embodiment of this application;

[0034] Figure 8 This is a schematic diagram of a terminal provided in an embodiment of this application. Detailed Implementation

[0035] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0036] The terms "first," "second," etc., used in this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same class, not limited in number; for example, the first object can be one or more. Furthermore, "or" in this application indicates at least one of the connected objects. For example, the scope of protection for "A or B" covers at least three scenarios: Scenario 1: including A but not B; Scenario 2: including B but not A; Scenario 3: including both A and B. In addition, the terms "A and / or B," "at least one of A and B," and "at least one of A or B" also cover at least the above three scenarios. The character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0037] In some embodiments, the 3D mesh is represented as a triangular mesh, which can be considered as consisting of three basic elements: vertices, edges, and faces, or including all three basic elements. Vertices are the most basic elements of the mesh, defining a position in 3D space. Edges are line segments connecting two vertices in the mesh. Faces can be viewed as polygons formed by closed paths of edges. For a triangular mesh, each face is a triangle.

[0038] The information contained in a 3D mesh is generally divided into three categories: geometric information, connectivity information, and attribute information. Geometric information refers to the position of each vertex of the mesh in 3D space. Connectivity information describes the relationships between elements in the mesh, i.e., the connections between vertices. Attribute information is optional; it can associate attributes with corresponding mesh elements (e.g., vertex color, normal vectors, etc., can be associated with mesh vertices). Mesh parameterization can also be used to map the mesh from 3D space to a 2D planar region. This mapping is usually described by a set of parametric coordinates, called UV coordinates or texture coordinates, associated with mesh vertices. This 2D mapping can be used to represent high-resolution attribute information, such as texture and normal vectors.

[0039] The information encoding method, decoding method, apparatus, and related equipment provided in this application will be described in detail below with reference to the accompanying drawings and through some embodiments and application scenarios.

[0040] Please see Figure 1 , Figure 1 This is a flowchart of an information encoding method provided in an embodiment of this application, such as... Figure 1 As shown, it includes the following steps:

[0041] Step 101: The encoding end writes the mesh stitching information into the first unit. The mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh.

[0042] The aforementioned encoding end can be implemented by software, hardware, or a combination thereof. When implemented by hardware, the encoding end can be referred to as an encoding end device or a video encoding device. For example, the aforementioned encoding end can be a terminal, server, or network-side device, such as a mobile phone, tablet computer, laptop computer, notebook computer, personal digital assistant (PDA), handheld computer, netbook, ultra-mobile personal computer (UMPC), mobile internet device (MID), augmented reality (AR) device, virtual reality (VR) device, robot, wearable device, flight vehicle, vehicle user equipment (VUE), shipboard equipment, pedestrian user equipment (PUE), smart home (home devices with wireless communication capabilities, such as refrigerators, televisions, washing machines, or furniture), game console, personal computer (PC), ATM, or self-service machine, etc.

[0043] The aforementioned three-dimensional mesh can be a three-dimensional mesh of an image or video.

[0044] The aforementioned mesh stitching information is used to stitch the sub-mesh of the 3D mesh. This can be understood as, after obtaining the aforementioned mesh stitching information at the decoding end, the sub-mesh of the 3D mesh can be stitched based on the mesh stitching information.

[0045] The stitching mentioned above can be the merging or fusion of scattered sub-mesh boundaries into a whole; therefore, the stitching mentioned above can also be called merging or fusion.

[0046] For example, to process regions of interest independently, a mesh can be divided into several sub-mesh segments (or sub-mesh pieces). After lossy compression of the sub-mesh, resulting in geometric information distortion, merging them back into the overall mesh often produces gaps or overlaps, impairing the subjective and objective quality of mesh decoding. Mesh stitching technology supports merging the boundaries of sub-mesh pieces as smoothly as possible after lossy compression of the sub-mesh, resulting in a decoded mesh model.

[0047] The aforementioned mesh stitching information can be either guidance information or stitching strategy information for stitching sub-mesh of a 3D mesh.

[0048] In addition, the above-mentioned mesh stitching information can be called supplemental enhancement information (SEI), or mesh stitching supplemental enhancement information.

[0049] The first unit mentioned above can be a Network Abstraction Layer Unit (NAL), such as a Tile (i.e., a tile or graph tile), where a Tile represents a virtual rectangular region in a graph atlas frame.

[0050] In addition to the aforementioned mesh stitching information, the first unit may or may not include other information.

[0051] In some implementations, the above-mentioned mesh stitching information can be written to only one cell, that is, only the first cell mentioned above.

[0052] In some implementations, the above-mentioned mesh stitching information can also be written into multiple units, such as the first unit and the second unit.

[0053] Step 102: The encoding end encodes the first unit to obtain a bitstream.

[0054] The aforementioned bitstream may include the encoding information of the first unit, and may or may not include the encoding information of other units.

[0055] In some implementations, after obtaining the bitstream, the encoding end also sends the bitstream to the decoding end. After receiving the bitstream, the decoding end obtains the mesh stitching information from the bitstream, and then stitches the sub-mesh of the three-dimensional mesh according to the mesh stitching information to obtain a three-dimensional mesh or a decoded mesh model.

[0056] The aforementioned decoding end can be implemented by software, hardware, or a combination thereof. When implemented by hardware, the decoding end can be referred to as a decoding end device or a video decoding device. For example, the aforementioned decoding end can be a terminal, server, or network-side device, such as a mobile phone, tablet personal computer, laptop computer, notebook computer, PDA, handheld computer, netbook, UMPC, MID, AR device, VR device, robot, wearable device, flight vehicle, VUE, shipborne equipment, PUE, smart home (home devices with wireless communication capabilities, such as refrigerators, televisions, washing machines, or furniture), game console, PC, ATM, or self-service machine, etc.

[0057] In this embodiment, encoding the mesh stitching information improves encoding performance, and the mesh stitching information enables the decoding end to support stitching sub-mesh of the 3D mesh, thereby improving decoding performance.

[0058] As an optional implementation, the mesh stitching information includes at least one of the following:

[0059] Suture type and suture parameters.

[0060] The above stitching type refers to the stitching of sub-mesh.

[0061] In some embodiments, the above-mentioned suture type includes at least one of the following:

[0062] Stitching based on distance, stitching based on index matching, and stitching based on boundary connection relationships.

[0063] Distance-based suturing can include at least one of the following:

[0064] Frame-level stitching, sub-mesh-level stitching, and boundary point-level stitching.

[0065] The above stitching types can ensure that the encoding and decoding ends understand the stitching type in the same way, thereby improving decoding performance.

[0066] It should be noted that the embodiments of this application do not limit the type of stitching, that is, it can be any type of stitching other than distance-based stitching, index-matching stitching, and boundary connection relationship stitching.

[0067] The above suturing parameters are those used in the suturing algorithm or during the suturing process.

[0068] In some embodiments, the above-mentioned suture parameters include at least one of the following:

[0069] Maximum matching distance, index of boundary point matching, number of subgrid cracks.

[0070] The maximum matching distance mentioned above can be a dynamically updated threshold, which is used to determine whether to accept the currently found matching object in subsequent stitching algorithms or stitching processes.

[0071] The index for the aforementioned boundary point matching can be the index of the matching sub-mesh and the index of the matching boundary point. This index is used to directly fuse the matching boundary points in the subsequent stitching algorithm.

[0072] The number of cracks in the subgrid mentioned above can be the number of boundary points at which cracks are identified on the subgrid boundary.

[0073] The stitching parameters described above ensure that the encoding and decoding ends understand the stitching parameters in the same way, thereby improving decoding performance.

[0074] It should be noted that, in some embodiments, the above-mentioned mesh stitching information may include the stitching type and stitching parameters, or one of the stitching type and stitching parameters, while the other may be pre-agreed, configured by the network-side device, or pre-negotiated.

[0075] As an optional implementation, the first unit includes at least one of the following:

[0076] A geometric unit containing geometric information;

[0077] An attribute unit that contains attribute information.

[0078] The geometric information mentioned above can also be called geometric data, and the attribute information mentioned above can also be called attribute data.

[0079] The geometric unit containing geometric information can be a geometric tile, and the attribute unit containing attribute information can be an attribute tile.

[0080] In this application embodiment, geometric units containing geometric information and attribute units containing attribute information can be encoded and transmitted separately, such as an encoding and decoding framework that separates geometric tiles and attribute tiles.

[0081] In the above embodiments, since the first unit includes a geometric unit containing geometric information, that is, the mesh stitching information is written into the geometric unit, the mesh stitching information and the geometric information can be transmitted together, ensuring coding consistency and improving coding performance.

[0082] In the above embodiments, since the first unit includes an attribute unit containing attribute information, i.e., the mesh stitching information is written into the attribute unit, the mesh stitching information and attribute information can be transmitted together, ensuring coding consistency and improving coding performance.

[0083] In some embodiments, the geometric unit containing geometric information includes:

[0084] The first geometric unit containing geometric information in the first frame.

[0085] The first frame mentioned above is the frame corresponding to the first unit, and the first frame mentioned above can be the current frame or a key frame.

[0086] The first geometric unit containing geometric information mentioned above can be determined based on the total number of units included in the frame. For example, the total number of Tiles in each frame is determined by both geometric Tiles and attribute Tiles. When writing mesh stitching algorithm to supplement enhancement information in the atlas sub-bitstream, the total number of Tiles included in the current frame is first calculated. This total number is determined by both geometric Tiles and attribute Tiles, and the first geometric tile of the current frame is located based on this total number of Tiles.

[0087] In the above embodiments, network stitching information can be written into the first geometric unit containing geometric information, which enables the decoding end to obtain network stitching information more effectively and reliably, thereby improving encoding performance. Furthermore, only the first geometric unit containing geometric information can be written, which can reduce the overhead of encoding and decoding.

[0088] In some implementations, other geometric units may also be written, and this is not limited.

[0089] In some implementations, the network stitching information described above can be written to only one geometric unit or attribute unit to reduce the overhead of encoding and decoding.

[0090] As an optional implementation, the first unit is the first unit of the first frame, and the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh of the first frame.

[0091] The aforementioned mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh of the first frame. This can be understood as stitching the sub-mesh of the first frame based on the mesh stitching information when decoding the first frame.

[0092] By writing the mesh stitching information into the first unit of the first frame, the decoding end can obtain and apply the mesh stitching information in a timely manner when decoding the first frame, thereby improving decoding efficiency.

[0093] In some implementations, the aforementioned mesh stitching information may be used only to stitch the sub-mesh of the three-dimensional mesh of the first frame, such as carrying corresponding mesh stitching information for each frame, which supports more flexible stitching.

[0094] In some implementations, the aforementioned mesh stitching information is also used to stitch the sub-mesh of the three-dimensional mesh in the second frame.

[0095] The second frame can be one or more frames before or after the first frame, and the second frame shares the same mesh stitching information with the first frame.

[0096] Since the mesh stitching information is also used to stitch the sub-mesh of the 3D mesh in the second frame, it is not necessary to encode the mesh stitching information during the encoding process of the second frame, thereby reducing the encoding overhead.

[0097] As an optional implementation, the method further includes:

[0098] The encoding end stitches the reconstructed sub-mesh, wherein the stitching of the reconstructed sub-mesh matches the mesh stitching information.

[0099] The reconstructed subgrid mentioned above is the subgrid reconstructed by the encoding end. For example, the encoding end first divides the three-dimensional grid (i.e., the input grid) into multiple subgrids, and encodes each subgrid independently to obtain the corresponding bitstream and the reconstructed subgrid.

[0100] The above-mentioned stitching of the reconstructed sub-mesh and the matching of the mesh stitching information can be understood as the mesh stitching information being the mesh stitching information used or corresponding to the stitching of the reconstructed sub-mesh by the encoding end.

[0101] In this embodiment, since the stitching of the reconstructed sub-mesh performed by the encoding end matches the mesh stitching information, the encoding end and the decoding end can have a consistent understanding of the mesh stitching, thereby improving the encoding and decoding performance.

[0102] In this embodiment, the encoding end writes mesh stitching information into a first unit, which is used to stitch sub-mesh of a 3D mesh; the encoding end encodes the first unit to obtain a bitstream. Encoding the mesh stitching information improves encoding performance, and the mesh stitching information also enables the decoding end to support stitching sub-mesh of the 3D mesh, thereby improving decoding performance.

[0103] Please see Figure 2 , Figure 2 This is a flowchart of an information decoding method provided in an embodiment of this application, such as... Figure 2 As shown, it includes the following steps:

[0104] Step 201: The decoding end parses the bitstream to obtain the first unit, which includes mesh stitching information. The mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh.

[0105] Step 202: The decoding end stitches the sub-mesh of the three-dimensional mesh according to the mesh stitching information.

[0106] Optionally, the mesh stitching information includes at least one of the following:

[0107] Suture type and suture parameters.

[0108] Optionally, the suture type includes at least one of the following:

[0109] Stitching based on distance, stitching based on index matching, and stitching based on boundary connection relationships.

[0110] Optionally, the suture parameters include at least one of the following:

[0111] Maximum matching distance, index of boundary point matching, number of subgrid cracks.

[0112] Optionally, the first unit includes at least one of the following:

[0113] Geometric units containing geometric information;

[0114] An attribute unit that contains attribute information.

[0115] Optionally, the geometric unit containing geometric information includes:

[0116] The first geometric unit containing geometric information in the first frame.

[0117] Optionally, the first unit is the first unit of the first frame, and the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh of the first frame.

[0118] Optionally, the mesh stitching information is also used to stitch the sub-mesh of the three-dimensional mesh in the second frame.

[0119] It should be noted that this embodiment is used as a reference for... Figure 1 The implementation methods of the corresponding decoding end in the illustrated embodiments can be found in the following examples. Figure 1 To avoid repetition, the relevant descriptions of the embodiments shown will not be repeated in this embodiment.

[0120] In one embodiment of this application, the method provided in this application can be applied to a video-based dynamic mesh coding (V-DMC) coding framework.

[0121] The overall framework of the V-DMC encoding end is as follows: Figure 3 As shown, for the input mesh, it is first simplified by a simplification module, then new texture coordinates are generated by mesh parameterization. Subsequently, the parameterized mesh is subdivided and deformed, i.e., new vertices are inserted into the mesh according to a specific subdivision method, and the distance from the subdivided mesh vertex to the nearest neighbor of the input mesh is calculated; this is called displacement information. Then, the vertex positions of the parameterized mesh, i.e., the mesh before subdivision and deformation, are adjusted based on the displacement information, and the adjusted mesh is called the base mesh, which is then sent to the base mesh encoding module for compression. When encoding the base mesh, it is divided into three types of sub-mesh for independent encoding. The base mesh is reconstructed after encoding, and then the displacement order is adjusted according to the vertex order of the reconstructed base mesh. Then, the adjusted vertex displacement information is first subjected to wavelet transform, the transformed coefficients are quantized, and then the quantized coefficients are arranged into the 2D image according to a specific scanning order. The 2D image is then encoded using a video encoder. Finally, the reconstructed displacement information is applied to the subdivided base mesh to obtain the reconstructed subdivided and deformed mesh. This mesh, along with the original input mesh and its corresponding texture map, is input into the corresponding texture map conversion module to obtain the texture map corresponding to the reconstructed mesh. This texture map is also encoded using a video encoder. Parameters used during the encoding process, such as the type of video encoder, mesh encoder, transform parameters, quantization parameters, etc., are transmitted to the decoding end through auxiliary information.

[0122] The overall framework of the V-DMC encoding decoding end is as follows: Figure 4 As shown, for the received bitstream, the decoder first demultiplexes the various parts of the bitstream to obtain the base mesh bitstream, the displacement video bitstream, the texture map video bitstream, and the auxiliary information bitstream. For the base mesh bitstream, a mesh decoder indicated by the auxiliary information is used to decode it to obtain the base mesh. The displacement video bitstream and the texture map video bitstream are decoded by a video decoder. For the displacement part, after video decoding, the displacement needs to be extracted from the image by a displacement decoding module, and then subjected to steps such as inverse quantization and inverse transform. This extracted displacement is then applied to the subdivided base mesh to obtain the deformed mesh reconstructed by the decoder. The texture map, after decoding, is the texture map corresponding to the reconstructed deformed mesh. Subsequent application or rendering modules use the reconstructed deformed mesh and the decoded texture map as input for processing.

[0123] It should be noted that the encoding method is not limited in the embodiments of this application, that is, it is not limited to V-DMC encoding, but can also be an encoding method defined by the Moving Pictures Experts Group (MPEG) or a newly defined encoding method thereafter.

[0124] In one embodiment provided in this application, a method for encoding and decoding mesh stitching information (also known as mesh stitching supplementary enhancement information) based on multi-Tile mode is proposed, which supports an encoding and decoding framework that separates geometry and attribute tiles.

[0125] In this embodiment, the proposed encoding and decoding method for mesh stitching information (also known as mesh stitching supplementary enhancement information) based on multi-Tile mode is applicable to mesh coding frameworks that support mesh stitching algorithms. During the encoding and decoding process, the writing and reading positions of mesh stitching information (also known as SEI information) are dynamically determined according to the Tile structure, ensuring that the mesh stitching information is correctly located in the first geometric Tile corresponding to each frame. By optimizing the writing strategy of mesh stitching information, the stability and compatibility of the encoding and decoding system are improved.

[0126] In some implementations, to better support the independent processing of geometric and attribute information, auxiliary information can be encoded and decoded on a tile-by-tile basis during atlas bitstream encoding. A tile represents a virtual rectangular region within an atlas frame, and each tile is represented by an independent NAL unit, which can be transmitted independently in the atlas bitstream. This separation of geometric tiles and attribute tiles allows for independent encoding and decoding of geometric and attribute data, improving flexibility and enhancing the adaptability and efficiency of dynamic mesh coding.

[0127] To process regions of interest independently, the mesh can be divided into several sub-mesh segments (also known as sub-mesh patches). When these sub-mesh segments undergo lossy compression, resulting in geometric information distortion, and are then merged back into a single mesh, gaps or overlaps often occur, impairing the subjective and objective quality of mesh decoding. Mesh stitching techniques support stitching the sub-mesh segments together (e.g., merging boundaries as smoothly as possible) after lossy compression to create a decoded mesh model.

[0128] When subgrid mode is enabled, the encoder first divides the input grid into multiple subgrids, each of which is independently encoded to obtain the corresponding bitstream and reconstructed subgrid. Finally, the reconstructed subgrids are stitched together to obtain the complete reconstructed grid. The stitching information (such as stitching guidance information) required by the decoder to implement the stitching algorithm is written into supplementary enhancement information and inserted into the tile corresponding to the keyframe (such as the first frame in the above embodiment) for encoding. At the decoder, the supplementary enhancement information in the keyframe tile is read to obtain information such as stitching type and stitching parameters. Based on different modes (such as different stitching types) in the supplementary enhancement information, the stitching algorithm is used to merge the subgrids to obtain the decoded grid.

[0129] In one embodiment provided in this application, the complete implementation process based on the V-DMC encoding / decoding framework according to the stitching information encoding / decoding scheme provided in this embodiment is as follows:

[0130] The encoding end includes the following:

[0131] (1) Mesh generation

[0132] Mesh generation supports both triangle density-based and vertically uniform mesh generation. The vertically uniform mesh generation algorithm divides the triangular mesh into uniform segments in the vertical direction and assigns the triangles to the corresponding sub-mesh segments based on the resulting sub-mesh range.

[0133] First, based on the maximum and minimum y-coordinates of the source mesh vertices, the vertical distance to the top sub-mesh is calculated. Taking a division of four sub-mesh as an example, the y-coordinate range is divided into four equal intervals. Then, the bounding box is set for each sub-mesh in a loop: the bounding box of the top sub-mesh directly uses the bounding box of the source mesh, while the bounding boxes of subsequent sub-mesh are set according to the bounding box of the previous sub-mesh, ensuring uniform division in the vertical direction.

[0134] After the bounding box is generated, the triangles in the source mesh are traversed. By evaluating the y-coordinates of each vertex of a triangle, its corresponding sub-mesh is determined, and the triangle is assigned to the corresponding sub-mesh. Finally, the sub-mesh is expanded. For each sub-mesh, the triangles are copied to the corresponding sub-mesh to complete the generation.

[0135] (2) Mesh stitching

[0136] The mesh stitching algorithm aims to merge scattered sub-mesh boundaries into a unified whole, thereby improving the subjective and objective quality of the decoded mesh. Taking distance-based stitching as an example, the maximum matching distance between two adjacent sub-mesh boundary points is first obtained. This distance is then used to perform matching and fusion operations on the boundary points to achieve sub-mesh boundary stitching. The maximum matching distance serves as a dynamically updated "threshold" used in subsequent stitching algorithms to determine whether to accept the currently found match. This stitching strategy can be further subdivided into three processing methods: frame-level, sub-mesh-level, and boundary point-level. For these three different stitching types, the corresponding maximum matching distance (maximum matching distance per frame, maximum matching distance per sub-mesh, and maximum matching distance per boundary point) is used for matching and fusion, respectively.

[0137] The algorithm for obtaining the maximum matching distance first analyzes the adjacency relationships of triangle vertices in the subgrid to identify the boundary vertices of each subgrid. Then, it traverses the boundary vertices, checking if the current vertex A matches. If vertex A does not match, the matching query logic is entered. During the matching query, a nearest neighbor algorithm (such as the KdTree algorithm) is used to find the nearest point to vertex A, thus determining the position of the nearest point B. Next, the matching status of the nearest point B is checked, confirming whether the nearest point B and the current point A are in the same subgrid to avoid self-matching. If point B and point A do not belong to the same subgrid, a match is considered successful. Vertices A and B are then marked as matched, and the boundary point information and corresponding boundary point matching distances are updated. After matching is complete, the maximum matching distance at the subgrid and frame levels is updated based on the distance between the matched points. Specifically, the maximum matching distance of a subgrid is defined as the maximum value among the matching distances of all boundary points within it, while the maximum matching distance of a frame is the maximum value among the matching distances of all boundary points in the current frame.

[0138] After obtaining the maximum matching distance at the encoder, the mesh can be stitched together using the zippering algorithm to reconstruct the mesh model. Finally, mesh stitching information is added to the encoded atlas bitstream and inserted into the geometric tiles in the keyframes for encoding. This helps the decoder better process and understand the details of the stitching process. For distance-based stitching types, the maximum acceptable matching distance during the matching process is set in the mesh stitching information.

[0139] (3) Supplemental Enhancement Information Encoding and Decoding

[0140] This embodiment, based on the V-DMC framework, proposes a video encoding method suitable for Tiles separation mode to ensure the correct writing of mesh stitching information.

[0141] In this embodiment, the total number of Tiles in each frame is determined by both geometric Tiles and attribute Tiles. When writing mesh stitching algorithm supplementary enhancement information into the atlas sub-bitstream, the total number of Tiles contained in the current frame is first calculated. This total number is determined by both geometric Tiles and attribute Tiles, and the first geometric tile of the current frame is located based on this total number of Tiles. Subsequently, the mesh stitching information is written into this tile and transmitted along with the geometric data to ensure that the decoder can parse it correctly.

[0142] The decoding end includes the following:

[0143] The decoder first parses the atlas bitstream and accurately locates the first geometric tile of the keyframe based on the total number of tiles in the keyframe. This tile stores mesh stitching information, including supplementary enhancement information such as the stitching type and stitching parameters required for sub-mesh stitching. The decoder parses this information to ensure correct guidance for sub-mesh merging during subsequent mesh reconstruction. For example, the zippering SEI is obtained from the AtlasTileLayerList using the index frameIndex*NumberOfTiles, which corresponds to the current frame. Based on this SEI information, the stitching type (such as zipMethod) is deduced.

[0144] The decoding end parses the mesh stitching information and determines the stitching type from the first geometric tile of the keyframe, which can ensure the consistency of sub-mesh stitching processing.

[0145] In some implementations, after acquiring the mesh stitching information of the keyframe, the decoding end independently decodes each sub-mesh frame by frame and obtains the decoded sub-mesh of the current frame. Subsequently, for each frame, the decoding end parses the mesh stitching information of that frame and determines the sub-mesh merging strategy based on data such as stitching type and stitching parameters in the information.

[0146] Sub-mesh merging is performed by a sub-mesh stitching algorithm, the process of which is consistent with that of the encoder. First, the stitching type of the current frame is evaluated based on network stitching information, and the matching relationship between boundary points of adjacent sub-mesh is determined by combining parameters such as the maximum matching distance. For sub-mesh that meet the matching conditions, topology adjustment and vertex fusion are performed to ensure the consistency of the mesh structure.

[0147] In this embodiment, the decoding end can accurately extract and utilize the mesh stitching information, enabling the mesh stitching information of the sub-mesh stitching algorithm to be transmitted along with the geometric data of each frame, thus ensuring encoding consistency. When the sub-mesh stitching mechanism is enabled, this method can correctly perform sub-mesh stitching in Tiles separation mode, effectively improving decoding stability and avoiding decoding failures or mesh topology inconsistencies caused by information loss or incorrect matching.

[0148] The information encoding method provided in this application can be executed by an information encoding device. As an example, the device can be an electronic device or a component within an electronic device, such as a chip or circuit. This application uses an information decoding device executing the information encoding method as an example to illustrate the information encoding device provided in this application.

[0149] The information decoding method provided in this application can be executed by an information decoding device. As an example, the device can be an electronic device or a component within an electronic device, such as a chip or circuit. This application uses an information decoding device executing the information decoding method as an example to illustrate the information decoding device provided in this application.

[0150] Please see Figure 5 , Figure 5 This is a structural diagram of an information encoding device provided in an embodiment of this application, such as... Figure 5 As shown, it includes:

[0151] Processing module 501 is used to write mesh stitching information into the first unit, wherein the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh;

[0152] The processing module 501 is also used to encode the first unit to obtain a bitstream.

[0153] Optionally, the mesh stitching information includes at least one of the following:

[0154] Suture type and suture parameters.

[0155] Optionally, the suture type includes at least one of the following:

[0156] Stitching based on distance, stitching based on index matching, and stitching based on boundary connection relationships.

[0157] Optionally, the suture parameters include at least one of the following:

[0158] Maximum matching distance, index of boundary point matching, number of subgrid cracks.

[0159] Optionally, the first unit includes at least one of the following:

[0160] Geometric units containing geometric information;

[0161] An attribute unit that contains attribute information.

[0162] Optionally, the geometric unit containing geometric information includes:

[0163] The first geometric unit containing geometric information in the first frame.

[0164] Optionally, the first unit is the first unit of the first frame, and the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh of the first frame.

[0165] Optionally, the mesh stitching information is also used to stitch the sub-mesh of the three-dimensional mesh in the second frame.

[0166] Optionally, the processing module 501 is further configured to stitch the reconstructed sub-mesh, wherein the stitching of the reconstructed sub-mesh is matched with the mesh stitching information.

[0167] The aforementioned information encoding device can improve encoding performance.

[0168] The information encoding device provided in this application embodiment can achieve... Figure 1 The various processes implemented in the method embodiments shown achieve the same technical effects, and will not be described again here to avoid repetition.

[0169] Please see Figure 6 , Figure 6 This is a structural diagram of an information decoding device provided in an embodiment of this application, as shown below. Figure 6 As shown, it includes:

[0170] The processing module 601 is used to parse the bitstream to obtain a first unit, the first unit including mesh stitching information, the mesh stitching information being used to stitch the sub-mesh of the three-dimensional mesh;

[0171] The processing module 601 is also used to stitch the sub-mesh of the three-dimensional mesh according to the mesh stitching information.

[0172] Optionally, the mesh stitching information includes at least one of the following:

[0173] Suture type and suture parameters.

[0174] Optionally, the suture type includes at least one of the following:

[0175] Stitching based on distance, stitching based on index matching, and stitching based on boundary connection relationships.

[0176] Optionally, the suture parameters include at least one of the following:

[0177] Maximum matching distance, index of boundary point matching, number of subgrid cracks.

[0178] Optionally, the first unit includes at least one of the following:

[0179] Geometric units containing geometric information;

[0180] An attribute unit that contains attribute information.

[0181] Optionally, the geometric unit containing geometric information includes:

[0182] The first geometric unit containing geometric information in the first frame.

[0183] Optionally, the first unit is the first unit of the first frame, and the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh of the first frame.

[0184] Optionally, the mesh stitching information is also used to stitch the sub-mesh of the three-dimensional mesh in the second frame.

[0185] The aforementioned information decoding device can improve encoding and decoding performance.

[0186] The information decoding device provided in this application embodiment can achieve... Figure 2 The various processes implemented in the method embodiments shown achieve the same technical effects, and will not be described again here to avoid repetition.

[0187] like Figure 7 As shown, this application also provides an electronic device 700, including a processor 701 and a memory 702. The memory 702 stores a program or instructions that can run on the processor 701. For example, when the electronic device 700 is an encoding device, the program or instructions, when executed by the processor 701, implement the various steps of the above-described information encoding method or information decoding method embodiments, and achieve the same technical effect. When the electronic device 700 is a decoding device, the program or instructions, when executed by the processor 701, implement the various steps of the above-described information encoding method or information decoding method embodiments, and achieve the same technical effect. To avoid repetition, further details are omitted here.

[0188] This application also provides an electronic device, including: a memory configured to store video data; and a processing circuit configured to implement the various steps of the above-described information encoding method or information decoding method embodiments.

[0189] This application embodiment also provides an electronic device, including a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement, for example... Figure 1 or Figure 2 The steps in the method embodiment shown are illustrated. This device embodiment corresponds to the above method embodiment, and all implementation processes and methods of the above method embodiments can be applied to this terminal embodiment and achieve the same technical effect.

[0190] The processor or processing circuit in this application embodiment may include general-purpose processors, special-purpose processors, etc., such as central processing units (CPUs), microprocessors, digital signal processors (DSPs), artificial intelligence (AI) processors, graphics processing units (GPUs), application-specific integrated circuits (ASICs), network processors (NPs), field-programmable gate arrays (FPGAs), or other programmable logic devices, gate circuits, transistors, discrete hardware components, etc. The communication interface in this application embodiment may include transceivers, pins, circuits, buses, etc.

[0191] The aforementioned electronic devices can be terminals or other devices besides terminals, such as servers, network attached storage (NAS), etc.

[0192] Among them, the terminal can also be called user equipment (UE), which can be a mobile phone, tablet computer, laptop computer, notebook computer, personal digital assistant (PDA), handheld computer, netbook, ultra-mobile personal computer (UMPC), mobile internet device (MID), augmented reality (AR), virtual reality (VR) device, mixed reality (MR) device, robot, wearable device, flight vehicle, vehicle user equipment (VUE), shipborne equipment, pedestrian user equipment (PUE), smart home (home devices with wireless communication functions, such as refrigerators, televisions, washing machines or furniture, etc.), game console, personal computer (PC), ATM or self-service machine, etc. Wearable devices include: smartwatches, smart bracelets, smart earphones, smart glasses, smart jewelry (smart bracelets, smart chains, smart rings, smart necklaces, smart anklets, smart anklets, etc.), smart wristbands, smart clothing, etc. Among these, in-vehicle devices can also be referred to as in-vehicle terminals, in-vehicle controllers, in-vehicle modules, in-vehicle components, in-vehicle chips, or in-vehicle units, etc. It should be noted that the embodiments in this application do not limit the specific type of terminal.

[0193] A server can be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server. A cloud server can provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), or cloud computing services based on big data and artificial intelligence platforms.

[0194] Taking electronic devices as terminals as an example, Figure 8 A schematic diagram of the hardware structure of a terminal to implement an embodiment of this application.

[0195] The terminal 800 includes, but is not limited to, at least some of the following components: radio frequency unit 801, network module 802, audio output unit 803, input unit 804, sensor 805, display unit 806, user input unit 807, interface unit 808, memory 809, and processor 810.

[0196] Those skilled in the art will understand that the terminal 800 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 810 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 8 The terminal structure shown does not constitute a limitation on the terminal. The terminal may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0197] It should be understood that, in this embodiment, the input unit 804 may include a graphics processor 8041 and a microphone 8042. The graphics processor 8041 processes image data of still images or videos obtained by an image acquisition device (such as a camera) in video acquisition mode or image acquisition mode, or it may process the obtained point cloud data. The display unit 806 may include a display panel 8061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 807 includes at least one of a touch panel 8071 and other input devices 8072. The touch panel 8071 is also called a touch screen. The touch panel 8071 may include two parts: a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0198] In this embodiment, after receiving downlink data from the network-side device, the radio frequency unit 801 can transmit it to the processor 810 for processing; in addition, the radio frequency unit 801 can send uplink data to the network-side device. Typically, the radio frequency unit 801 includes, but is not limited to, antennas, amplifiers, transceivers, couplers, low-noise amplifiers, duplexers, etc.

[0199] The memory 809 can be used to store software programs or instructions, as well as various data. The memory 809 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 809 may include volatile memory or non-volatile memory. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 809 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0200] Processor 810 may include one or more processing units; optionally, processor 810 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 810.

[0201] In the above embodiment where the terminal is the encoding end:

[0202] The processor 810 is used to write mesh stitching information into a first unit, the mesh stitching information being used to stitch sub-mesh of a three-dimensional mesh; and to encode the first unit to obtain a bitstream.

[0203] Optionally, the mesh stitching information includes at least one of the following:

[0204] Suture type and suture parameters.

[0205] Optionally, the suture type includes at least one of the following:

[0206] Stitching based on distance, stitching based on index matching, and stitching based on boundary connection relationships.

[0207] Optionally, the suture parameters include at least one of the following:

[0208] Maximum matching distance, index of boundary point matching, number of subgrid cracks.

[0209] Optionally, the first unit includes at least one of the following:

[0210] Geometric units containing geometric information;

[0211] An attribute unit that contains attribute information.

[0212] Optionally, the geometric unit containing geometric information includes:

[0213] The first geometric unit containing geometric information in the first frame.

[0214] Optionally, the first unit is the first unit of the first frame, and the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh of the first frame.

[0215] Optionally, the mesh stitching information is also used to stitch the sub-mesh of the three-dimensional mesh in the second frame.

[0216] Optionally, the processor 810 is also configured to stitch the reconstructed sub-mesh, wherein the stitching of the reconstructed sub-mesh matches the mesh stitching information.

[0217] In the above embodiment where the terminal is the decoding end:

[0218] The processor 810 is used to parse the bitstream to obtain a first unit, the first unit including mesh stitching information, the mesh stitching information being used to stitch the sub-mesh of the three-dimensional mesh; and stitching the sub-mesh of the three-dimensional mesh according to the mesh stitching information.

[0219] Optionally, the mesh stitching information includes at least one of the following:

[0220] Suture type and suture parameters.

[0221] Optionally, the suture type includes at least one of the following:

[0222] Stitching based on distance, stitching based on index matching, and stitching based on boundary connection relationships.

[0223] Optionally, the suture parameters include at least one of the following:

[0224] Maximum matching distance, index of boundary point matching, number of subgrid cracks.

[0225] Optionally, the first unit includes at least one of the following:

[0226] Geometric units containing geometric information;

[0227] An attribute unit that contains attribute information.

[0228] Optionally, the geometric unit containing geometric information includes:

[0229] The first geometric unit containing geometric information in the first frame.

[0230] Optionally, the first unit is the first unit of the first frame, and the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh of the first frame.

[0231] Optionally, the mesh stitching information is also used to stitch the sub-mesh of the three-dimensional mesh in the second frame.

[0232] The aforementioned terminals can improve encoding performance.

[0233] It is understood that the implementation process of each implementation method mentioned in this embodiment can refer to the relevant description of the method embodiment and achieve the same or corresponding technical effect. To avoid repetition, it will not be described again here.

[0234] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described information encoding method or information decoding method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0235] The processor mentioned above is the processor in the terminal described in the above embodiments. The readable storage medium includes computer-readable storage media, such as ROM, RAM, magnetic disk, or optical disk. In some examples, the readable storage medium may be a non-transient readable storage medium.

[0236] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described information encoding method or information decoding method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0237] It should be understood that the chips mentioned in the embodiments of this application may include system-on-a-chip (also known as system chip, chip system, or system-on-a-chip) or discrete display chips, etc.

[0238] This application also provides a computer program / program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described information encoding method or information decoding method embodiments, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0239] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0240] From the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of computer software products plus necessary general-purpose hardware platforms, and of course, they can also be implemented by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.), and the computer software product includes several instructions to cause the terminal or network-side device to execute the methods described in the various embodiments of this application.

[0241] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other implementations under the guidance of this application without departing from the spirit and scope of the claims. All of these implementations are within the protection scope of this application.

Claims

1. An information encoding method, characterized in that, include: The encoding end writes mesh stitching information into the first unit, and the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh; The encoding end encodes the first unit to obtain a bitstream.

2. The method according to claim 1, characterized in that, The mesh stitching information includes at least one of the following: Suture type and suture parameters.

3. The method according to claim 2, characterized in that, The suture type includes at least one of the following: Stitching based on distance, stitching based on index matching, and stitching based on boundary connection relationships.

4. The method according to claim 2 or 3, characterized in that, The suture parameters include at least one of the following: Maximum matching distance, index of boundary point matching, number of subgrid cracks.

5. The method according to any one of claims 1 to 4, characterized in that, The first unit includes at least one of the following: Geometric units containing geometric information; An attribute unit that contains attribute information.

6. The method according to claim 5, characterized in that, The geometric unit containing geometric information includes: The first geometric unit containing geometric information in the first frame.

7. The method according to any one of claims 1 to 6, characterized in that, The first unit is the first unit of the first frame, and the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh of the first frame.

8. The method according to claim 7, characterized in that, The mesh stitching information is also used to stitch the sub-mesh of the 3D mesh in the second frame.

9. The method according to any one of claims 1 to 8, characterized in that, The method further includes: The encoding end stitches the reconstructed sub-mesh, wherein the stitching of the reconstructed sub-mesh matches the mesh stitching information.

10. An information decoding method, characterized in that, include: The decoding end parses the bitstream to obtain the first unit, which includes mesh stitching information. The mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh. The decoding end stitches the sub-mesh of the three-dimensional mesh according to the mesh stitching information.

11. The method according to claim 10, characterized in that, The mesh stitching information includes at least one of the following: Suture type and suture parameters.

12. The method according to claim 11, characterized in that, The suture type includes at least one of the following: Stitching based on distance, stitching based on index matching, and stitching based on boundary connection relationships.

13. The method according to claim 11 or 12, characterized in that, The suture parameters include at least one of the following: Maximum matching distance, index of boundary point matching, number of subgrid cracks.

14. The method according to any one of claims 10 to 13, characterized in that, The first unit includes at least one of the following: Geometric units containing geometric information; An attribute unit that contains attribute information.

15. The method according to claim 14, characterized in that, The geometric unit containing geometric information includes: The first geometric unit containing geometric information in the first frame.

16. The method according to any one of claims 10 to 15, characterized in that, The first unit is the first unit of the first frame, and the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh of the first frame.

17. The method according to claim 16, characterized in that, The mesh stitching information is also used to stitch the sub-mesh of the 3D mesh in the second frame.

18. An information encoding device, characterized in that, include: The processing module is used to write mesh stitching information into the first unit, wherein the mesh stitching information is used to stitch the sub-mesh of the three-dimensional mesh; The processing module is also used to encode the first unit to obtain a bitstream.

19. The apparatus according to claim 18, characterized in that, The mesh stitching information includes at least one of the following: Suture type and suture parameters.

20. The apparatus according to claim 18 or 19, characterized in that, The processing module is also used to stitch the reconstructed sub-mesh, wherein the stitching of the reconstructed sub-mesh is matched with the mesh stitching information.

21. An information decoding device, characterized in that, include: The processing module is used to parse the bitstream to obtain a first unit, the first unit including mesh stitching information, which is used to stitch the sub-mesh of the three-dimensional mesh; The processing module is also used to stitch the sub-mesh of the three-dimensional mesh according to the mesh stitching information.

22. The apparatus according to claim 21, characterized in that, The mesh stitching information includes at least one of the following: Suture type and suture parameters.

23. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the information encoding method as described in any one of claims 1 to 9, or to implement the steps of the information decoding method as described in any one of claims 10 to 17.

24. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the information encoding method as described in any one of claims 1 to 9, or the steps of the information decoding method as described in any one of claims 10 to 17.

25. A chip, characterized in that, The chip includes a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the steps of the information encoding method as described in any one of claims 1 to 9, or to implement the steps of the information decoding method as described in any one of claims 10 to 17.

26. A computer program product, characterized in that, The computer program product is stored in a storage medium and is executed by at least one processor to implement the steps of the information encoding method as described in any one of claims 1 to 9, or to implement the steps of the information decoding method as described in any one of claims 10 to 17.

Images