Method and apparatus for decoding and encoding base-mesh
The method and apparatus improve encoding and decoding of 3D volumetric video data by manipulating mesh handles, addressing the challenge of large data size and hardware requirements, enabling efficient compression and immersive experiences.
Patent Information
- Application Number
- PCT/KR2025/013009
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-08-18
- Filing Date
- 2025-08-26
- Publication Date
- 2026-03-05
AI Technical Summary
Existing technologies face challenges in efficiently encoding and decoding 3D volumetric video data, such as point clouds and polygonal meshes, due to their large data size and the need for specialized hardware, which hinders seamless transmission and immersive experiences.
The method and apparatus provide improved encoding and decoding of base-mesh handles by using processors to obtain and manipulate mesh handles, reconstructing base meshes, and generating bitstreams, allowing for efficient compression and transmission of 3D data.
This approach enables efficient compression and transmission of 3D data, reducing the need for specialized hardware and enhancing immersive experiences by allowing users to interactively view and navigate 3D content with six degrees of freedom.
Smart Images

Figure KR2025013009_05032026_PF_FP_ABST
Abstract
Description
METHOD AND APPARATUS FOR DECODING AND ENCODING BASE-MESH
[0001] This disclosure relates generally to multimedia devices and processes. More specifically, this disclosure relates to base-mesh handle coding
[0002] Three hundred sixty degree (360°) video and three dimensional (3D) volumetric video are emerging as new ways of experiencing immersive content due to the ready availability of powerful handheld devices such as smartphones. While 360° video enables an immersive "real life," "being-there," experience for consumers by capturing the 360° outside-in view of the world, 3D volumetric video can provide a complete six degrees of freedom (DoF) experience of being immersed and moving within the content. Users can interactively change their viewpoint and dynamically view any part of the captured scene or object they desire. Display and navigation sensors can track head movement of a user in real-time to determine the region of the 360° video or volumetric content that the user wants to view or interact with. Multimedia data that is 3D in nature, such as point clouds or 3D polygonal meshes, can be used in the immersive environment. This data can be stored in a video format and encoded and compressed for transmission as a bitstream to other devices
[0003] This disclosure provides method and apparatus for encoding and decoding base-mesh handle.
[0004] In an embodiment of the disclosure, an apparatus for decoding base-mesh is provided. The apparatus may comprise at least one memory storing one or more instructions, and one or more processors including processing circuitry. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to obtain a bitstream comprising a base mesh sub-bitstream including a value associated with mesh handle. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to determine a final value based on adding an offset to the value associated with mesh handle. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to reconstruct a base mesh using the final value.
[0005] In an embodiment of the disclosure, an apparatus for encoding base-mesh is provided. The apparatus may include at least one memory storing one or more instructions; and one or more processors including processing circuitry. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to obtain a value associated with a mesh handle of a base mesh. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to determine a coded value based on subtracting an offset from the value associated with the mesh handle of the base mesh. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to generate a bitstream including the coded value.
[0006] In an embodiment of the disclosure, a method for transmitting the bitstream generated by an apparatus for encoding base-mesh is provided. The method may include obtain a value associated with a mesh handle of a base mesh. The method may include determine a coded value based on subtracting an offset from the value associated with the mesh handle of the base mesh. The method may include generate the bitstream including the coded value.
[0007] For a more complete understanding of the present disclosure and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings, in which like reference numerals represent like parts:
[0008] Figure 1 illustrates an example communication system in accordance with this disclosure;
[0009] Figure 2 illustrates example apparatus in accordance with this disclosure;
[0010] Figure 3 illustrates example apparatus in accordance with this disclosure;
[0011] Figure 4 illustrates an example encoding process in accordance with this disclosure;
[0012] Figure 5 illustrates an example mesh frame decoding process in accordance with this disclosure;
[0013] Figure 6a illustrates an example mesh in accordance with this disclosure;
[0014] Figure 6b illustrates an example mesh in accordance with this disclosure;
[0015] Figure 6c illustrates an example mesh in accordance with this disclosure;
[0016] Figure 7 illustrates example binarization coding information;
[0017] Figure 8 illustrates example binarization coding information in accordance with this disclosure;
[0018] Figure 9 illustrates example binarization coding information where groups of 3 bits are used to represent the mesh handle information, but no offset is used;
[0019] Figure 10 illustrates example binarization coding information using groups of 3 bits, and using an offset, in accordance with this disclosure;
[0020] Figure 11 illustrates example binarization coding information using a maximum number of offsets, in accordance with this disclosure;
[0021] Figure 12 illustrates an example encoding method in accordance with this disclosure; and
[0022] Figure 13 illustrates an example decoding method in accordance with this disclosure.
[0023] Hereinafter, embodiments of the disclosure will be described in detail with reference to the accompanying drawings.
[0024] In describing the embodiments, descriptions related to technical contents well-known in the art and not associated directly with the disclosure will be omitted. Such an omission of unnecessary descriptions is intended to prevent obscuring of the main idea of the disclosure and more clearly transfer the main idea.
[0025] For the purpose of promoting an understanding of the principles of the present disclosure, reference will now be made to the various embodiments and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the present disclosure is thereby intended, such alterations and further modifications in the illustrated system, and such further applications of the principles of the present disclosure as illustrated therein being contemplated as would normally occur to one skilled in the art to which the present disclosure relates.
[0026] It will be understood by those skilled in the art that the foregoing general description and the following detailed description are explanatory of the present disclosure and are not intended to be restrictive thereof.
[0027] For the same reason, in the accompanying drawings, some elements may be exaggerated, omitted, or schematically illustrated. Further, the size of each element does not completely reflect the actual size. In the drawings, identical or corresponding elements are provided with identical reference numerals or different reference numerals. For the sake of clarity, the first digit of a reference numeral of each component of the present disclosure is indicative of the Figure number, in which the corresponding component is shown. For example, reference numerals starting with digit "1" are shown at least in Figure 1. Similarly, reference numerals starting with digit "2" are shown at least in Figure 2
[0028] The advantages and features of the disclosure and ways to achieve them will be apparent by making reference to embodiments as described below in detail in conjunction with the accompanying drawings. However, the disclosure is not limited to the embodiments set forth below, but may be implemented in various different forms. The following embodiments are provided only to completely disclose the disclosure and inform those skilled in the art of the scope of the disclosure, and the disclosure is defined only by the scope of the appended claims. Throughout the specification, the same or like reference numerals designate the same or like elements. Furthermore, in describing the disclosure, a detailed description of known functions or constitution incorporated herein will be omitted in the case that it is determined that the description may make the subject matter of the disclosure unnecessarily unclear. The terms which will be described below are terms defined in consideration of the functions in the disclosure, and may be different according to users, intentions of the operators, or customs. Therefore, the definitions of the terms should be made based on the contents throughout the specification.
[0029] Reference is made herein to some "embodiments." It should be understood that an embodiment is an example of a possible implementation of any features and / or elements of the present disclosure. Some embodiments have been described for the purpose of explaining one or more of the potential ways in which the specific features and / or elements of the proposed disclosure fulfil the requirements of uniqueness, utility, and non-obviousness.
[0030] Use of the phrases and / or terms including, but not limited to, "a first embodiment," "a further embodiment," "an alternate embodiment," "one embodiment," "an embodiment," "multiple embodiments," "some embodiments," "other embodiments," "further embodiment", "furthermore embodiment", "additional embodiment" or other variants thereof do not necessarily refer to the same embodiments. Unless otherwise specified, one or more particular features and / or elements described in connection with one or more embodiments may be found in one embodiment, or may be found in more than one embodiment, or may be found in all embodiments, or may be found in no embodiments. Although one or more features and / or elements may be described herein in the context of only a single embodiment, or in the context of more than one embodiment, or in the context of all embodiments, the features and / or elements may instead be provided separately or in any appropriate combination or not at all. Conversely, any features and / or elements described in the context of separate embodiments may alternatively be realized as existing together in the context of a single embodiment.
[0031] Any particular and all details set forth herein are used in the context of some embodiments and therefore should not necessarily be taken as limiting factors to the proposed disclosure.
[0032] Herein, it will be understood that each block of the flowchart illustrations, and combinations of blocks in the flowchart illustrations, may be performed based on computer program instructions. These computer program instructions may be loaded collectively onto at least one processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which perform through any one of, or in any combination of, the at least one processor of the computer or other programmable data processing apparatus, create means for performing the functions specified in the flowchart block(s). The entirety of the one or more computer programs may be stored in a single memory or the one or more computer programs may be divided with different portions stored in different multiple memories. The computer program instructions may also be stored in a non-transitory computer usable or computer-readable memory that may direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer usable or computer-readable memory produce an article of manufacture including instruction means that perform the function specified in the flowchart block(s). The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable data processing apparatus to produce a computer executed process such that the instructions that perform on the computer or other programmable data processing apparatus provide steps for executing the functions specified in the flowchart block(s).
[0033] Further, each block may represent a module, segment, or portion of code, which includes one or more executable instructions for executing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks may occur out of the order. For example, two blocks(or functions) shown in succession may in fact be performed substantially concurrently or the blocks may sometimes be performed in the reverse order, depending upon the functionality involved.
[0034] As used in embodiments of the disclosure, a "~unit" may refer to a software element or a hardware element, such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC), which performs a predetermined function. However, the term including the word "~unit" does not always have a meaning limited to software or hardware. The "~unit" may be constructed either to be stored in an addressable storage medium or to execute one or more processors. Therefore, the "~unit" includes, for example, software elements, object-oriented software elements, components such as class elements and task elements, processes, functions, properties, procedures, sub-routines, segments of a program code, drivers, firmware, micro-codes, circuits, data, database, data structures, tables, arrays, and parameters. The components and functions provided by the "~unit" may be either combined into a smaller number of components and a "~unit," or divided into additional components and a "~unit." Moreover, the components and "~units" may be implemented to reproduce one or more central processing units (CPUs) within a device or a security multimedia card. Further, in the embodiments, the "~unit" may include one or more processors.
[0035] It should be appreciated that the blocks in each flowchart and combinations of the flowcharts may be performed by one or more computer programs which include instructions. The entirety of the one or more computer programs may be stored in a single memory device or the one or more computer programs may be divided with different portions stored in different multiple memory devices.
[0036] Any of the functions or operations described herein can be processed by one processor or a combination of processors. The one processor or the combination of processors is circuitry performing processing and includes circuitry like an application processor (AP, e.g. a CPU), a communication processor (CP, e.g., a modem), a graphics processing unit (GPU), a neural processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a Wi-Fi chip, a Bluetooth® chip, a global positioning system (GPS) chip, a near field communication (NFC) chip, connectivity chips, a sensor controller, a touch controller, a finger-print sensor controller, a display driver integrated circuit (IC), an audio CODEC chip, a universal serial bus (USB) controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system on chip (SoC), an IC, or the like.
[0037] It will be appreciated that various embodiments of the disclosure according to the claims and description in the specification can be realized in the form of hardware, software or a combination of hardware and software.
[0038] Any such software may be stored in non-transitory computer readable storage media. The non-transitory computer readable storage media store one or more computer programs (software modules), the one or more computer programs include computer-executable instructions that, when executed by one or more processors of an apparatus individually or collectively, cause the apparatus to perform a method of the disclosure.
[0039] Any such software may be stored in the form of volatile or non-volatile storage such as, for example, a storage device like read only memory (ROM), whether erasable or rewritable or not, or in the form of memory such as, for example, random access memory (RAM), memory chips, device or integrated circuits or on an optically or magnetically readable medium such as, for example, a compact disk (CD), digital versatile disc (DVD), magnetic disk or magnetic tape or the like. It will be appreciated that the storage devices and storage media are various embodiments of non-transitory machine-readable storage that are suitable for storing a computer program or computer programs comprising instructions that, when executed, implement various embodiments of the disclosure. Accordingly, various embodiments of the present disclosure may provide a program comprising code for implementing apparatus or a method as claimed in any one of the claims of this specification and a non-transitory machine-readable storage storing such a program.
[0040] Hereinafter, the determination of priority between A and B in the present disclosure may refer to various actions such as selecting the one having a higher priority based on a predefined priority rule and performing an operation corresponding thereto, or omitting or dropping an operation corresponding to the one having a lower priority.
[0041] Hereinafter, "A or B" as described in the present disclosure may be understood as "A and / or B," which may include A, or B, or both A and B.
[0042] In addition, "at least one of A, B, and C" as described in the present disclosure may be understood to include A, or B, or C, or any combination of A, B, and C.
[0043] In addition, "at least one of A, B, or C" as described in the present disclosure may be understood to include A, or B, or C, or any combination of A, B, and C.
[0044] Furthermore, "A / B" as described in the present disclosure may be understood as "A and / or B," which may include A, or B, or both A and B.
[0045] Furthermore, "A, B" as described in the present disclosure may be understood as "A and / or B," which may include A, or B, or both A and B.
[0046] Furthermore, "A and B" as described in the present disclosure may be understood as "A and / or B," which may include A, or B, or both A and B.
[0047] Furthermore, "if condition A and condition B are satisfied," as described in the present disclosure, may not be limited to a case where both condition A and condition B are satisfied, but may be understood to include a case where either condition A or condition B is individually satisfied, both condition A and condition B are satisfied, or one or more additional conditions are satisfied in combination.
[0048] Furthermore, the terms "first ~", "second ~", etc., as described in the present disclosure with respect to various elements (e.g., information, objects, operation, sequences, or the like), should not limit those elements. These terms may only be intended to distinguish one element from another, and may not be intended to indicate a specific order. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element.
[0049] Furthermore, even if "first ~" and "second ~" are described in the present disclosure, it may be understood that element(s) referred to by "first ~" and "second ~" may be the same or different. For example, in case of element(s) being information, first information and second information may both be same information and, in some cases, are separate and different information.
[0050] Whether or not a certain feature or element was limited to being used only once, it may still be referred to as "one or more features" or "one or more elements" or "at least one feature" or "at least one element." Furthermore, the use of the terms "one or more" or "at least one" feature or element do not preclude there being none of that feature or element, unless otherwise specified by limiting language including, but not limited to, "there needs to be one or more..." or "one or more elements is required."
[0051] The terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process or method that comprises a list of steps does not include only those steps but may include other steps not expressly listed or inherent to such process or method. Similarly, one or more devices or sub-systems or elements or structures or components proceeded by "comprises... a" does not, without more constraints, preclude the existence of other devices or other sub-systems or other elements or other structures or other components or additional devices or additional sub-systems or additional elements or additional structures or additional components.
[0052] In addition, the terms "if ~" and "in case that ~" as used in the disclosure or claims may be interpreted to include the meanings of "when (or upon) ~," "in response to ~," "based on ~," or "according to ~," and may be used interchangeably with these expressions. In addition, expressions other than those exemplified herein may also be used, as long as they have substantially the same meaning and do not impair the technical features of the present disclosure.
[0053] In addition, the term "not perform" as used in the present disclosure or claims may, in context, be understood to mean that the corresponding step is omitted or skipped. Such a term may be replaced with other terms having the same or substantially equivalent meaning.
[0054] In the specific embodiments of the present disclosure described below, terms or components included in the disclosure may be expressed in singular or plural form depending on the specific embodiments presented. However, such singular or plural expressions are selected appropriately for convenience of description, and the present disclosure is not limited to a singular or plural number of components. A component expressed in the plural form may be implemented as a single component, and a component expressed in the singular form may be implemented as multiple components.
[0055] The drawings or flowcharts described below illustrate exemplary methods that may be implemented according to the principles of the present disclosure, and various modifications may be made to the methods illustrated in the flowcharts of the present disclosure. For example, although illustrated as a series of steps, various steps in each drawing or flowchart may overlap, occur in parallel, occur in a different order, or be repeated. In other examples, any step may be omitted or replaced with another step.
[0056] The methods and apparatuses proposed in the embodiments of the present disclosure are not limited to each embodiment individually, but may also be applied in combination of all or some of the embodiments proposed in the disclosure. Therefore, the embodiments of the present disclosure may be modified and applied without significantly departing from the scope of the present disclosure, as would be understood by those skilled in the art.
[0057] In this case, even if certain wordings are described differently across embodiments, they may be used interchangeably or in substitution or in combination if their underlying concepts are equivalent. For example, for the same or equivalent concept, even if one embodiment uses the expression "A" and another embodiment uses the expression "B", such expressions may be understood interchangeably, in substitution, or in combination.
[0058] Other technical features may be readily apparent to one skilled in the art from the following figures, descriptions, and claims.
[0059] Before undertaking the DETAILED DESCRIPTION below, it may be advantageous to set forth definitions of certain words and phrases used throughout this patent document. The term "couple" and its derivatives refer to any direct or indirect communication between two or more elements, whether or not those elements are in physical contact with one another. The terms "transmit," "receive," and "communicate," as well as derivatives thereof, encompass both direct and indirect communication. The terms "include" and "comprise," as well as derivatives thereof, mean inclusion without limitation. The term "or" is inclusive, meaning and / or. The phrase "associated with," as well as derivatives thereof, means to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, have a relationship to or with, or the like. The term "controller" means any device, system, or part thereof that controls at least one operation. Such a controller may be implemented in hardware or a combination of hardware and software and / or firmware. The functionality associated with any particular controller may be centralized or distributed, whether locally or remotely. The phrase "at least one of," when used with a list of items, means that different combinations of one or more of the listed items may be used, and only one item in the list may be needed. For example, "at least one of: A, B, and C" includes any of the following combinations: A, B, C, A and B, A and C, B and C, and A and B and C.
[0060] Moreover, various functions described below can be implemented or supported by one or more computer programs, each of which is formed from computer readable program code and embodied in a computer readable medium. The terms "application" and "program" refer to one or more computer programs, software components, sets of instructions, procedures, functions, objects, classes, instances, related data, or a portion thereof adapted for implementation in a suitable computer readable program code. The phrase "computer readable program code" includes any type of computer code, including source code, object code, and executable code. The phrase "computer readable medium" includes any type of medium capable of being accessed by a computer, such as read only memory (ROM), random access memory (RAM), a hard disk drive, a compact disc (CD), a digital video disc (DVD), or any other type of memory. A "non-transitory" computer readable medium excludes wired, wireless, optical, or other communication links that transport transitory electrical or other signals. A non-transitory computer readable medium includes media where data can be permanently stored and media where data can be stored and later overwritten, such as a rewritable optical disc or an erasable memory device.
[0061] Definitions for other certain words and phrases are provided throughout this patent document. Those of ordinary skill in the art should understand that in many if not most instances, such definitions apply to prior as well as future uses of such defined words and phrases.
[0062] Embodiments of the present disclosure will be described below in detail with reference to the accompanying drawings.
[0063] Figures 1 through 13, described below, and the various embodiments used to describe the principles of the present disclosure are by way of illustration only and should not be construed in any way to limit the scope of the disclosure. Those skilled in the art will understand that the principles of the present disclosure may be implemented in any type of suitably arranged device or system.
[0064] As noted above, three hundred sixty degree (360°) video and three dimensional (3D) volumetric video are emerging as new ways of experiencing immersive content due to the ready availability of powerful handheld devices such as smartphones. While 360° video enables an immersive "real life," "being-there," experience for consumers by capturing the 360° outside-in view of the world, 3D volumetric video can provide a complete six degrees of freedom (DoF) experience of being immersed and moving within the content. Users can interactively change their viewpoint and dynamically view any part of the captured scene or object they desire. Display and navigation sensors can track head movement of a user in real-time to determine the region of the 360° video or volumetric content that the user wants to view or interact with. Multimedia data that is 3D in nature, such as point clouds or 3D polygonal meshes, can be used in the immersive environment. This data can be stored in a video format and encoded and compressed for transmission as a bitstream to other devices.
[0065] A point cloud is a set of 3D points along with attributes such as color, normal directions, reflectivity, point-size, etc. that represent an object's surface or volume. Point clouds are common in a variety of applications such as gaming, 3D maps, visualizations, medical applications, augmented reality, virtual reality, autonomous driving, multi-view replay, and six degrees of freedom (DoF) immersive media, to name a few. Point clouds, if uncompressed, generally require a large amount of bandwidth for transmission. Due to the large bitrate requirement, point clouds are often compressed prior to transmission. Compressing a 3D object such as a point cloud, often requires specialized hardware. To avoid specialized hardware to compress a 3D point cloud, a 3D point cloud can be transformed into traditional two-dimensional (2D) frames and that can be compressed and later reconstructed and viewable to a user.
[0066] Polygonal 3D meshes, especially triangular meshes, are another popular format for representing 3D objects. Meshes typically include a set of vertices, edges and faces that are used for representing the surface of 3D objects. Triangular meshes are simple polygonal meshes in which the faces are simple triangles covering the surface of the 3D object. Typically, there may be one or more attributes associated with the mesh. In one scenario, one or more attributes may be associated with each vertex in the mesh. For example, a texture attribute (RGB) may be associated with each vertex. In another scenario, each vertex may be associated with a pair of coordinates, (u, v). The (u, v) coordinates may point to a position in a texture map associated with the mesh. For example, the (u, v) coordinates may refer to row and column indices in the texture map, respectively. A mesh can be thought of as a point cloud with additional connectivity information.
[0067] The point cloud or meshes may be dynamic, i.e., they may vary with time. In these cases, the point cloud or mesh at a particular time instant may be referred to as a point cloud frame or a mesh frame, respectively. Since point clouds and meshes contain a large amount of data, they require compression for efficient storage and transmission. This is particularly true for dynamic point clouds and meshes, which may contain 60 frames or higher per second.
[0068] As part of an encoding process, a base mesh can be coded using an existing mesh codec, and a reconstructed base mesh can be constructed from the coded original mesh. The reconstructed base mesh can then be subdivided into one or more subdivided meshes and a displacement field is created for each subdivided mesh.
[0069] This disclosure provides for improvements to base mesh handle coding. As noted above, a base mesh, which is a decimated version of an original mesh to minimize the amount of compressed data, is created.
[0070] In some instance in this disclosure, the term "submesh" can refers to the partitioning of the base mesh. A standard for video-based compression of dynamic meshes is currently in development. A base mesh, which typically has less number of vertices compared to the original mesh, is created and compressed either in a lossy or lossless manner. The reconstructed base mesh undergoes subdivision and then a displacement field between the original mesh and the subdivided reconstructed base mesh is calculated. This disclosure relates to improvements to the coding of handle information in the base-mesh.
[0071] In an embodiment of the disclosure, the mesh handle may include information indicating the number of topological handles (i.e., genus, or holes) included in a mesh surface. The handle information may represent the count of distinct through-holes or tunnels in the mesh, and may be utilized in a mesh encoding / decoding process to resolve ambiguities in connectivity information and to ensure accurate reconstruction of the original mesh topology.
[0072] Figure 1 illustrates an example communication system 100 in accordance with this disclosure. The embodiment of the communication system 100 shown in Figure 1 is for illustration only. An embodiment of the communication system 100 may be used without departing from the scope of this disclosure.
[0073] In an embodiment of the disclosure, As shown in Figure 1, the communication system 100 includes a network 102 that facilitates communication between various components in the communication system 100. For example, the network 102 may communicate IP packets, frame relay frames, Asynchronous Transfer Mode (ATM) cells, or other information between network addresses. The network 102 includes one or more local area networks (LANs), metropolitan area networks (MANs), wide area networks (WANs), all or a portion of a global network such as the Internet, or any other communication system or systems at one or more locations.
[0074] In an embodiment of the disclosure, the network 102 facilitates communications between a server 104 and various client devices 106-116. The client devices 106-116 may be, for example, a smartphone, a tablet computer, a laptop, a personal computer, a TV, an interactive display, a wearable device, a HMD, or the like. The server 104 may represent one or more servers. Each server 104 includes any suitable computing or processing device that may provide computing services for one or more client devices, such as the client devices 106-116. Each server 104 could, for example, include one or more processing devices, one or more memories storing instructions and data, and one or more network interfaces facilitating communication over the network 102. As described in more detail below, the server 104 may transmit a compressed bitstream, representing a point cloud or mesh, to one or more display devices, such as a client device 106-116. In an embodiment, each server 104 may include an encoder.
[0075] In an embodiment of the disclosure, each client device 106-116 represents any suitable computing or processing device that interacts with at least one server (such as the server 104) or other computing device(s) over the network 102. The client devices 106-116 include a desktop computer 106, a mobile telephone or mobile device 108 (such as a smartphone), a PDA 110, a laptop computer 112, a tablet computer 114, and a HMD 116. However, any other or additional client devices could be used in the communication system 100. Smartphones represent a class of mobile devices 108 that are handheld devices with mobile operating systems and integrated mobile broadband cellular network connections for voice, short message service (SMS), and Internet data communications. The HMD 116 may display 360° scenes including one or more dynamic or static 3D point clouds or mesh. In an embodiment, any of the client devices 106-116 may include an encoder, decoder, or both. For example, the mobile device 108 may record a 3D volumetric video and then encode the video enabling the video to be transmitted to one of the client devices 106-116. In another example, the laptop computer 112 may be used to generate a 3D point cloud or mesh, which is then encoded and transmitted to one of the client devices 106-116.
[0076] In an embodiment of the disclosure, some client devices 108-116 communicate indirectly with the network 102. For example, the mobile device 108 and PDA 110 communicate via one or more base stations 118, such as cellular base stations or eNodeBs (eNBs). Also, the laptop computer 112, the tablet computer 114, and the HMD 116 communicate via one or more wireless access points 120, such as IEEE 802.11 wireless access points. Note that these are for illustration only and that each client device 106-116 could communicate directly with the network 102 or indirectly with the network 102 via any suitable intermediate device(s) or network(s). In an embodiment, the server 104 or any client device 106-116 may be used to compress a point cloud or mesh, generate a bitstream that represents the point cloud or mesh, and transmit the bitstream to another client device such as any client device 106-116.
[0077] In an embodiment of the disclosure, any of the client devices 106-114 transmit information securely and efficiently to another device, such as, for example, the server 104. Also, any of the client devices 106-116 may trigger the information transmission between itself and the server 104. Any of the client devices 106-114 may function as a VR display when attached to a headset via brackets, and function similar to HMD 116. For example, the mobile device 108 when attached to a bracket system and worn over the eyes of a user may function similarly as the HMD 116. The mobile device 108 (or any other client device 106-116) may trigger the information transmission between itself and the server 104.
[0078] In an embodiment of the disclosure, any of the client devices 106-116 or the server 104 may create a 3D point cloud or mesh, compress a 3D point cloud or mesh, transmit a 3D point cloud or mesh, receive a 3D point cloud or mesh, decode a 3D point cloud or mesh, render a 3D point cloud or mesh, or a combination thereof. For example, the server 104 may compress a 3D point cloud or mesh to generate a bitstream and then transmit the bitstream to one or more of the client devices 106-116. As another example, one of the client devices 106-116 may compress a 3D point cloud or mesh to generate a bitstream and then transmit the bitstream to another one of the client devices 106-116 or to the server 104. In accordance with this disclosure, the server 104 and / or the client devices 106-116 may use a number of vertices of the original mesh and / or distortion information for each reconstruction iteration to simplify submeshes. Additionally or alternatively, in accordance with this disclosure, the server 104 and / or the client devices 106-116 may use a copy of a decimated mesh for reconstructing one or more submeshes. In an embodiment, the server 104 and / or the client devices 106-116 may construct and transmit signaling information instructing another device to use a number of vertices of the original mesh and / or distortion information for each reconstruction iteration to simplify submeshes and / or create and use a copy of a decimated mesh for reconstructing one or more submeshes.
[0079] Although Figure 1 illustrates one example of a communication system 100, various changes may be made to Figure 1. For example, the communication system 100 could include any number of each component in any suitable arrangement. In general, computing and communication systems come in a wide variety of configurations, and Figure 1 does not limit the scope of this disclosure to any particular configuration. While Figure 1 illustrates one operational environment in which various features disclosed in this patent document may be used, these features could be used in any other suitable system.
[0080] Figure 2 illustrates example apparatus in accordance with this disclosure.
[0081] In an embodiment of the disclosure, Figure 2 illustrates an example server 200, and the server 200 could represent the server 104 in Figure 1. The server 200 may represent one or more encoders, decoders, local servers, remote servers, clustered computers, and components that act as a single pool of seamless resources, a cloud-based server, and the like. The server 200 may be accessed by one or more of the client devices 106-116 of Figure 1 or another server. Meanwhile, the apparatus of the present disclosure may be an electronic device. In addition, the description given with respect to the apparatus may equally or similarly apply to the electronic device. And, the description given with respect to the electronic device may equally or similarly apply to the apparatus.
[0082] As shown in Figure 2, the server 200 may represent one or more local servers, one or more compression servers, or one or more encoding servers, such as an encoder. In an embodiment, the encoder may perform decoding. As shown in Figure 2, the server 200 includes a bus system 205 that supports communication between at least one processing device (such as a processor 210), at least one storage device 215, at least one communications interface 220, and at least one input / output (I / O) unit 225.
[0083] In an embodiment of the disclosure, the processor 210 executes instructions that may be stored in a memory 230. The processor 210 may include any suitable number(s) and type(s) of processors or other devices in any suitable arrangement. Example types of processors 210 include microprocessors, microcontrollers, digital signal processors, field programmable gate arrays, application specific integrated circuits, and discrete circuitry.
[0084] In an embodiment of the disclosure, the processor 210 may encode a 3D point cloud or mesh stored within the storage devices 215. In an embodiment, encoding a 3D point cloud also decodes the 3D point cloud or mesh to ensure that when the point cloud or mesh is reconstructed, the reconstructed 3D point cloud or mesh matches the 3D point cloud or mesh prior to the encoding. In an embodiment, the processor 210 may use a number of vertices of the original mesh and / or distortion information for each reconstruction iteration to simplify submeshes. Additionally or alternatively, the processor 210 may create and use a copy of a decimated mesh for reconstructing one or more submeshes as described in this disclosure. In an embodiment, the processor 210 may construct and transmit signaling information instructing another device to use a number of vertices of the original mesh and / or distortion information for each reconstruction iteration to simplify submeshes and / or create and use a copy of a decimated mesh for reconstructing one or more submeshes.
[0085] In an embodiment of the disclosure, the memory 230 and a persistent storage 235 are examples of storage devices 215 that represent any structure(s) capable of storing and facilitating retrieval of information (such as data, program code, or other suitable information on a temporary or permanent basis). The memory 230 may represent a random access memory or any other suitable volatile or non-volatile storage device(s). For example, the instructions stored in the memory 230 may include instructions for decomposing a point cloud into patches, instructions for packing the patches on 2D frames, instructions for compressing the 2D frames, as well as instructions for encoding 2D frames in a certain order in order to generate a bitstream. The instructions stored in the memory 230 may also include instructions for rendering the point cloud or mesh on an omnidirectional 360° scene, as viewed through a VR headset, such as HMD 116 of Figure 1. The persistent storage 235 may contain one or more components or devices supporting longer-term storage of data, such as a read only memory, hard drive, Flash memory, or optical disc.
[0086] In an embodiment of the disclosure,the communications interface 220 supports communications with other systems or devices. For example, the communications interface 220 could include a network interface card or a wireless transceiver facilitating communications over the network 102 of Figure 1. The communications interface 220 may support communications through any suitable physical or wireless communication link(s). For example, the communications interface 220 may transmit a bitstream containing a 3D point cloud to another device such as one of the client devices 106-116.
[0087] In an embodiment of the disclosure, the I / O unit 225 allows for input and output of data. For example, the I / O unit 225 may provide a connection for user input through a keyboard, mouse, keypad, touchscreen, or other suitable input device. The I / O unit 225 may also send output to a display, printer, or other suitable output device. Note, however, that the I / O unit 225 may be omitted, such as when I / O interactions with the server 200 occur via a network connection.
[0088] In an embodiment of the disclosure, note that while Figure 2 is described as representing the server 104 of Figure 1, the same or similar structure could be used in one or more of the various client devices 106-116. For example, a desktop computer 106 or a laptop computer 112 could have the same or similar structure as that shown in Figure 2.
[0089] Figure 3 illustrates example apparatus in accordance with this disclosure.
[0090] In an embodiment of the disclosure, Figure 3 illustrates an example apparatus 300, and the apparatus 300 could represent one or more of the client devices 106-116 in Figure 1. The apparatus 300 may be a mobile communication device, such as, for example, a mobile station, a subscriber station, a wireless terminal, a desktop computer (similar to the desktop computer 106 of Figure 1), a portable electronic device (similar to the mobile device 108, the PDA 110, the laptop computer 112, the tablet computer 114, or the HMD 116 of Figure 1), and the like. In an embodiment, one or more of the client devices 106-116 of Figure 1 may include the same or similar configuration as the apparatus 300. In an embodiment, the apparatus 300 is an encoder, a decoder, or both. For example, the apparatus 300 is usable with data transfer, image or video compression, image or video decompression, encoding, decoding, and media rendering applications.
[0091] In an embodiment of the disclosure, as shown in Figure 3, the apparatus 300 includes an antenna 305, a radio-frequency (RF) transceiver 310, transmit (TX) processing circuitry 315, a microphone 320, and receive (RX) processing circuitry 325. The RF transceiver 310 may include, for example, a RF transceiver, a BLUETOOTH transceiver, a WI-FI transceiver, a ZIGBEE transceiver, an infrared transceiver, and various other wireless communication signals. The apparatus 300 also includes a speaker 330, a processor 340, an input / output (I / O) interface (IF) 345, an input 350, a display 355, a memory 360, and a sensor(s) 365. The memory 360 includes an operating system (OS) 361, and one or more applications 362.
[0092] In an embodiment of the disclosure, the RF transceiver 310 receives from the antenna 305, an incoming RF signal transmitted from an access point (such as a base station, WI-FI router, or BLUETOOTH device) or other device of the network 102 (such as a WI-FI, BLUETOOTH, cellular, 5G, LTE, LTE-A, WiMAX, or any other type of wireless network). The RF transceiver 310 down-converts the incoming RF signal to generate an intermediate frequency or baseband signal. The intermediate frequency or baseband signal is sent to the RX processing circuitry 325 that generates a processed baseband signal by filtering, decoding, and / or digitizing the baseband or intermediate frequency signal. The RX processing circuitry 325 transmits the processed baseband signal to the speaker 330 (such as for voice data) or to the processor 340 for further processing (such as for web browsing data).
[0093] In an embodiment of the disclosure, the TX processing circuitry 315 receives analog or digital voice data from the microphone 320 or other outgoing baseband data from the processor 340. The outgoing baseband data may include web data, e-mail, or interactive video game data. The TX processing circuitry 315 encodes, multiplexes, and / or digitizes the outgoing baseband data to generate a processed baseband or intermediate frequency signal. The RF transceiver 310 receives the outgoing processed baseband or intermediate frequency signal from the TX processing circuitry 315 and up-converts the baseband or intermediate frequency signal to an RF signal that is transmitted via the antenna 305.
[0094] In an embodiment of the disclosure, the processor 340 may include one or more processors or other processing devices. The processor 340 may execute instructions that are stored in the memory 360, such as the OS 361 in order to control the overall operation of the apparatus 300. For example, the processor 340 could control the reception of forward channel signals and the transmission of reverse channel signals by the RF transceiver 310, the RX processing circuitry 325, and the TX processing circuitry 315 in accordance with well-known principles. The processor 340 may include any suitable number(s) and type(s) of processors or other devices in any suitable arrangement. For example, in an embodiment, the processor 340 includes at least one microprocessor or microcontroller. Example types of processor 340 include microprocessors, microcontrollers, digital signal processors, field programmable gate arrays, application specific integrated circuits, and discrete circuitry.
[0095] In an embodiment of the disclosure, the processor 340 is also capable of executing other processes and programs resident in the memory 360, such as operations that receive and store data. The processor 340 may move data into or out of the memory 360 as required by an executing process. In an embodiment, the processor 340 is configured to execute the one or more applications 362 based on the OS 361 or in response to signals received from external source(s) or an operator. Example, applications 362 may include an encoder, a decoder, a VR or AR application, a camera application (for still images and videos), a video phone call application, an email client, a social media client, a SMS messaging client, a virtual assistant, and the like. In an embodiment, the processor 340 is configured to receive and transmit media content.
[0096] In an embodiment, the processor 340 may use a number of vertices of the original mesh and / or distortion information for each reconstruction iteration to simplify submeshes. Additionally or alternatively, the processor 340 may create and use a copy of a decimated mesh for reconstructing one or more submeshes as described in this disclosure. In an embodiment, the processor 340 may construct and transmit signaling information instructing another device to use a number of vertices of the original mesh and / or distortion information for each reconstruction iteration to simplify submeshes and / or create and use a copy of a decimated mesh for reconstructing one or more submeshes.
[0097] In an embodiment of the disclosure, the processor 340 is also coupled to the I / O interface 345 that provides the apparatus 300 with the ability to connect to other devices, such as client devices 106-114. The I / O interface 345 is the communication path between these accessories and the processor 340.
[0098] In an embodiment of the disclosure, the processor 340 is also coupled to the input 350 and the display 355. The operator of the apparatus 300 may use the input 350 to enter data or inputs into the apparatus 300. The input 350 may be a keyboard, touchscreen, mouse, track ball, voice input, or other device capable of acting as a user interface to allow a user in interact with the apparatus 300. For example, the input 350 may include voice recognition processing, thereby allowing a user to input a voice command. In another example, the input 350 may include a touch panel, a (digital) pen sensor, a key, or an ultrasonic input device. The touch panel may recognize, for example, a touch input in at least one scheme, such as a capacitive scheme, a pressure sensitive scheme, an infrared scheme, or an ultrasonic scheme. The input 350 may be associated with the sensor(s) 365 and / or a camera by providing additional input to the processor 340. In an embodiment, the sensor 365 includes one or more inertial measurement units (IMUs) (such as accelerometers, gyroscope, and magnetometer), motion sensors, optical sensors, cameras, pressure sensors, heart rate sensors, altimeter, and the like. The input 350 may also include a control circuit. In the capacitive scheme, the input 350 may recognize touch or proximity.
[0099] In an embodiment of the disclosure, the display 355 may be a liquid crystal display (LCD), light-emitting diode (LED) display, organic LED (OLED), active matrix OLED (AMOLED), or other display capable of rendering text and / or graphics, such as from websites, videos, games, images, and the like. The display 355 may be sized to fit within an HMD. The display 355 may be a singular display screen or multiple display screens capable of creating a stereoscopic display. In an embodiment, the display 355 is a heads-up display (HUD). The display 355 may display 3D objects, such as a 3D point cloud or mesh.
[0100] In an embodiment of the disclosure, the memory 360 is coupled to the processor 340. Part of the memory 360 could include a RAM, and another part of the memory 360 could include a Flash memory or other ROM. The memory 360 may include persistent storage (not shown) that represents any structure(s) capable of storing and facilitating retrieval of information (such as data, program code, and / or other suitable information). The memory 360 may contain one or more components or devices supporting longer-term storage of data, such as a read only memory, hard drive, Flash memory, or optical disc. The memory 360 also may contain media content. The media content may include various types of media such as images, videos, three-dimensional content, VR content, AR content, 3D point clouds, meshes, and the like.
[0101] In an embodiment of the disclosure, the apparatus 300 further includes one or more sensors 365 that may meter a physical quantity or detect an activation state of the apparatus 300 and convert metered or detected information into an electrical signal. For example, the sensor 365 may include one or more buttons for touch input, a camera, a gesture sensor, an IMU sensors (such as a gyroscope or gyro sensor and an accelerometer), an eye tracking sensor, an air pressure sensor, a magnetic sensor or magnetometer, a grip sensor, a proximity sensor, a color sensor, a bio-physical sensor, a temperature / humidity sensor, an illumination sensor, an Ultraviolet (UV) sensor, an Electromyography (EMG) sensor, an Electroencephalogram (EEG) sensor, an Electrocardiogram (ECG) sensor, an IR sensor, an ultrasound sensor, an iris sensor, a fingerprint sensor, a color sensor (such as a Red Green Blue (RGB) sensor), and the like. The sensor 365 may further include control circuits for controlling any of the sensors included therein.
[0102] In an embodiment of the disclosure, as discussed in greater detail below, one or more of these sensor(s) 365 may be used to control a user interface (UI), detect UI inputs, determine the orientation and facing the direction of the user for three-dimensional content display identification, and the like. Any of these sensor(s) 365 may be located within the apparatus 300, within a secondary device operably connected to the apparatus 300, within a headset configured to hold the apparatus 300, or in a singular device where the apparatus 300 includes a headset.
[0103] In an embodiment of the disclosure, the apparatus 300 may create media content such as generate a virtual object or capture (or record) content through a camera. The apparatus 300 may encode the media content to generate a bitstream, such that the bitstream may be transmitted directly to another apparatus or indirectly such as through the network 102 of Figure 1. The apparatus 300 may receive a bitstream directly from another apparatus or indirectly such as through the network 102 of Figure 1.
[0104] Although Figures 2 and 3 illustrate examples of apparatuses, various changes may be made to Figures 2 and 3. For example, various components in Figures 2 and 3 could be combined, further subdivided, or omitted and additional components could be added according to particular needs. As a an example, the processor 340 could be divided into multiple processors, such as one or more central processing units (CPUs) and one or more graphics processing units (GPUs). In addition, as with computing and communication, apparatuses and servers may come in a wide variety of configurations, and Figures 2 and 3 do not limit this disclosure to any particular apparatus or server.
[0105] Figure 4 illustrates an example encoding process 400 in accordance with this disclosure. The encoding process 400 illustrated in Figure 4 is for illustration only. Figure 4 does not limit the scope of this disclosure to any particular implementation of an encoding process. For ease of explanation, the process 400 of Figure 4 may be described as being performed using the apparatus 300 of Figure 3. However, the process 400 may be used with any other suitable system and any other suitable electronic device.
[0106] In an embodiment of the disclosure, as shown in Figure 4, the encoding process 400 performs pre-processing 402 on a dynamic mesh sequence using an encoder. The encoder may be represented by, or executed by, the server 200 shown in Figure 2 or the apparatus 300 shown in Figure 3. A base mesh, which typically has a smaller number of vertices compared to the original mesh, is created via the pre-processing 402. A base mesh encoder 404 is used to quantize and compress the base mesh in either a lossy or lossless manner, and the base mesh is encoded as a compressed base mesh sub-bitstream. The base-mesh may be intra coded (no prediction from neighboring base mesh frames) or inter coded (predicted from neighboring base-mesh frames).
[0107] In an embodiment of the disclosure, the base mesh may then be reconstructed, providing a reconstructed base mesh. This reconstructed base mesh then undergoes one or more levels of subdivision and a displacement field is created by a displacement encoder 406 for each subdivision representing the difference between the original mesh and the subdivided reconstructed base mesh. In inter-coding of a mesh frame, the base mesh is coded by sending vertex motions instead of compressing the base mesh directly. In either case, a displacement field is created. Each displacement of the displacement field has three components, denoted by x, y, and z. These may be with respect to a canonical coordinate system or a local coordinate system where x, y, and z represent the displacement in local normal, tangent, and bi-tangent directions. It will be understood that multiple levels of subdivision may be applied, such that multiple subdivided mesh frames are created and a displacement field for each subdivided mesh frame is also created. As shown in Figure 4, a displacement sub-bitstream is provided by the displacement encoder 406.
[0108] In an embodiment of the disclosure, as also shown in Figure 4, an attribute transfer operation may be performed using an video encoder 408. The video encoder 408 may use a deformed mesh, a static / dynamic mesh, and an attribute map to create an attribute sub-bitstream. The vertices of the mesh are a set of 3D points along with attributes such as color, normals, reflectivity, point-size, etc. that represent an object's surface or volume. These attributes are encoded as a compressed attribute bitstream. The encoding of the compressed attribute sub-bitstream may also include a padding operation, a color space conversion operation, and a video encoding operation. In various embodiments, an atlas may also be encoded as a compressed atlas sub-bitstream using an atlas encoder 410. The atlas component provides information to a decoding and / or rendering system on how to perform inverse reconstruction. For example, the atlas may provide information on how to perform the subdivision of a base mesh, how to apply the displacement vectors to the subdivided mesh vertices, and how to apply attributes to the reconstructed mesh.
[0109] In an embodiment of the disclosure, each of the sub-bitstreams are provided to a multiplexer 412. The multiplexer 412 multiplexes the sub-bitstreams and outputs a compressed bitstream (e.g., a V3C bitstream) that may, for example, be transmitted to, and decoded by, an electronic device such as the server 104 or the client devices 106-116. As shown in Figure 4, the output compressed bitstream may include the compressed atlas bitstream, the compressed base mesh bitstream, the compressed displacements bitstream, and the compressed attribute bitstream as sub-bitstreams of the compressed bitstream.
[0110] In an embodiment of the disclosure, although Figure 4 illustrates one example encoding process 400, various changes may be made to Figure 4. For example, the number and placement of various components of the encoding process 400 may vary as needed or desired. In addition, the encoding process 400 may be used in any other suitable process and is not limited to the specific processes described above.
[0111] Figure 5 illustrates an example mesh frame decoding process 500 in accordance with this disclosure. In an embodiment of the disclosure, the decoding process 500 illustrated in Figure 5 is for illustration only. Figure 5 does not limit the scope of this disclosure to any particular implementation of a mesh frame decoding process. For ease of explanation, the process 500 of Figure 5 may be described as being performed using the apparatus 300 of Figure 3. However, the process 500 may be used with any other suitable system and any other suitable electronic device.
[0112] In an embodiment of the disclosure, the decoding process 500 involves a demultiplexer 502 of a decoder that receives an incoming bitstream, e.g., the bitstream output by the encoder of the process 400 of Figure 4. The demultiplexer 502 separates out the various component sub-bitstreams from the incoming bitstream, including the compressed base mesh sub-bitstream, the compressed displacement sub-bitstream, the compressed attribute sub-bitstream, and the atlas sub-bitstream, such as described with respect to Figure 4. The compressed attribute sub-bitstream is decoded using a video decoder 504, the decoded attributes are processed using a color space conversion operation, and the original attributes for the mesh are recovered. The decoding process also may include processing the atlas sub-bitstream using an atlas decoder 506 to obtain the atlas data for the base mesh. The atlas sub-bitstream may be decoded to obtain an atlas that provides information on how to perform inverse reconstruction. For example, the atlas may provide information on how to perform the subdivision of a base mesh, how to apply the displacement vectors to the subdivided mesh vertices, and how to apply attributes to the reconstructed mesh.
[0113] In an embodiment of the disclosure, the decoding process 500 also includes processing the base mesh sub-stream using a base mesh decoder 508. The base mesh decoder 508 decodes the base-mesh sub-bitstream to form a reconstructed base-mesh 512. A base mesh processing operation 509 is used with a displacement processing operation 511 to apply subdivision to the reconstructed base-mesh 512. Particularly, the decoding process 500 includes decoding the displacements sub-bitstream using a displacement decoder 510, which may, in an embodiment, be the same decoder as the video decoder 504. The decoded displacements data may undergo an image unpacking operation, an inverse quantization operation, and an inverse wavelet transform operation, as part of recovering the positions displacements data. Recovering the positions displacements data may also include performing using displacement processing operation 511 on the mesh frames recovered using a base mesh decoder 508, and extracting x, y, z components (normal, tangent, bitangent) from the subdivided mesh frames. The received displacement field is decompressed and added to the reconstructed base-mesh 512 as part of a reconstruction operation 514 to generate a final reconstructed mesh in the decoder, e.g., the reconstructed dynamic mesh sequence shown in Figure 5.
[0114] In an embodiment of the disclosure, although Figure 5 illustrates one example frame decoding process 500, various changes may be made to Figure 5. For example, the number and placement of various components of the decoding process 500 may vary as needed or desired. In addition, the decoding process 500 may be used in any other suitable process and is not limited to the specific processes described above. Also, while shown as a series of steps, various steps in Figure 5 may overlap, occur in parallel, or occur any number of times.
[0115] Various standards have been proposed with respect to vertex mesh and dynamic mesh coding. The following documents are hereby incorporated by reference in their entirety as if fully set forth herein:
[0116] "V-DMC TMM 8.0, ISO / IEC SC29 WG07 N00874," June 2024;
[0117] "CD of V-DMC, ISO / IEC SC29 WG07 N00885," June 2024; and
[0118] "Study of CD of V-DMC, ISO / IEC SC29 WG07 N00960," August 2024.
[0119] Figure 6a illustrates an example mesh in accordance with this disclosure. Figure 6b illustrates an example mesh in accordance with this disclosure. Figure 6c illustrates an example mesh in accordance with this disclosure.
[0120] Figures 6a-6c illustrate example meshes 600, 601, and 602 in accordance with this disclosure. The example meshes 600, 601, and 602 illustrated in Figures 6a-6c, respectively, are for illustration only. Figures 6a-6c do not limit the scope of this disclosure to any particular type o of mesh. For ease of explanation, the example meshes 600, 601, and 602 of Figures 6a-6c may be described as being used by the apparatus 300 of Figure 3 as part of mesh encoding / decoding, such as that described with respect to Figures 4 and 5. However, the example meshes 600, 601, and 602 may be used with any other suitable system and any other suitable electronic device.
[0121] In an embodiment of the disclosure, the example mesh 600 of Figure 6a has 0 handles, the example mesh 601 of Figure 6b has 1 handle, and the example mesh 600 of Figure 6a has 9 handles. When the triangles in these meshes are traversed, such as via an edge breaker algorithm, there is an ambiguity in the connectivity information and the two associated corner indices of the handle need to be transmitted to deal with this ambiguity. For example, in V-DMC, the syntax used for transmitting the handle information may be as shown in Table 1 below.
[0122]
[0123] [Table 1]
[0124] In an embodiment of the disclosure, the syntax elements shown in Table 1 are as follows. mesh_handles_count[ i ] specifies the number of handles comprised in the i-th connected component with non zero handle count. mesh_handle_first_delta[ i ] specifies the difference between the i-th handle first corner and the (i - 1)-th handle first corner when i is greater than 0. When i is equal to 0 mesh_handle_index_first_delta[ 0 ] specifies the first handle first corner. mesh_handle_second_delta[ i ] specifies the difference between the i-th handle second corner and the (i - 1)-th handle second corner when i is greater than 0.
[0125] In an embodiment of the disclosure, when i is equal to 0 mesh_handle_index_second_delta[ 0 ] specifies the first handle second corner. mesh_handle_first_sign[ i ] specifies if the handle is associated with a boundary or not. When mesh_handle_first_sign[ i ] is equal to 0, the corner index associated with the i-th handle first corner will be smaller than zero, indicating that the handle is associated with a boundary. When mesh_handle_first_sign[ i ] is equal to 1, the corner index associated with the i-th handle first corner will be greater than zero, indicating that the handle is not associated with a boundary mesh_handle_second_shift[ i ] specifies the shift to apply when computing the corner index associated with the i-th handle second corner.
[0126] In an embodiment of the disclosure, note that handle indices are relative to a triangle / face, index as related corner indices may be deduced implicitly. The corner index of the fist handle is conforming to either ( 3 * T + 2 ) or ( -3 * T - 2 ). The corner index of the second handle f index is conforming to either ( 3 * T + 1 ) or ( 3 * T + 2 ). mesh_handle_first_sign[ i ] and mesh_handle_index_second_shift[ i ] are used to discriminate those cases.
[0127] In an embodiment of the disclosure, mesh_handle_first_variable_delta_length4_minus1[ i ] specifies the number of groups of four bits used to represent mesh_handle_first_variable_delta[ i ]. mesh_handle_first_variable_delta[ i ] specifies an intermediate value used to evaluate the corner index associated with the i-th handle first corner.
[0128] In an embodiment of the disclosure, the number of bits used to represent mesh_handle_first_variable_delta[ i ] is equal to ( 4 * ( mesh_handle_index_first_variable_delta_length4_minus1 + 1 ) ).
[0129] In an embodiment of the disclosure, mesh_handle_index_second_variable_delta_length4_minus1[ i ] specifies the number of groups of four bits used to represent mesh_handle_second_variable_delta[ i ]. mesh_handle_second_variable_delta[ i ] specifies an intermediate value used to evaluate the corner index associated with the i-th handle second corner.
[0130] In an embodiment of the disclosure, the number of bits used to represent mesh_handle_second_variable_delta[ i ] is equal to ( 4 * ( mesh_handle_index_second_variable_delta_length4_minus1 + 1 ) ).
[0131] For example, let a 2D array HandlesArray, of size mesh_handles_count Х 2, specifying for each handle two associated corner indices, be derived as follows:
[0132]
[0133] A combination of variable length coding (non-arithmetic coding, mesh_handles_count < MinHandles) and arithmetic coding (mesh_handles_count >= MinHandles) is used for coding the handle information.
[0134] Figure 7 illustrates example binarization coding information 700. When arithmetic coding is used, mesh_handle_first_variable_delta and mesh_handle_second_variable_delta are coded using the binarization shown in Figure 7.
[0135] mesh_handle_first_variable_delta_length4_minus1 and mesh_handle_second_variable_delta_length4_minus1 syntax elements (indicated as "mesh_handle_X_variable_delta_length4_minus1" in Figure 7) are binarized using truncated unary code, whereas mesh_handle_first_variable_delta and mesh_handle_second_variable_delta syntax elements (indicated as "mesh_handle_X_variable_delta" in Figure 7) are coded using a fixed length binarization. The number of bins used for mesh_handle_X_variable_delta is 4 * (mesh_handle_X_variable_delta_length4_minus1 + 1).
[0136] As shown in Figure 7, 'x' indicates either a 0 or 1. The "..." shown in the last row of Figure 7 indicates that there are more code words that follow the same logic of Figure 7, and as defined in the V-DMC specification. However, it may be noticed from Figure 7 that there are some unused codewords leading to loss in compression efficiency. The present disclosure seeks to alleviate and improve upon these inefficiencies.
[0137] For example, this disclosure provides, in an embodiment, for using only arithmetic coding for coding the mesh handle information. This is like setting MinHandles to 0 to trigger use of arithmetic coding, eliminating the need to check the mesh handles count as in existing implementations. For illustrative purposes, the corresponding modifications to the syntax elements are shown in Table 2 below. Syntax elements that are no longer needed with resepect to the checking of the minimum handles count are shown as deletions via bolded brackets: [ ].
[0138]
[0139] [Table 2]
[0140] As shown above in Table 2, this disclosure discards with checking the handles count against a minimum to determine if variable length (non-arithmetic) coding or arithmetic coding is to be used, and instead uses just arithmetic coding. This alone (using just arithmetic coding to code the handle information) has been found to provide for bitrate savings in the coding of the base-mesh, such as savings of -0.04%. The gain is observed in sequences that have handle information.
[0141] Additionally, it may be seen in Figure 7 that there are some unused codewords, which leads to losses in compression efficiency. This disclosure thus also provides for modifying the coded values such that there are no unused codewords.
[0142] Figure 8 illustrates example binarization coding information 800 in accordance with this disclosure.
[0143] In an embodiment of the disclosure, the binarization coding information 800 illustrated in Figure 8 is for illustration only. Figure 8 does not limit the scope of this disclosure to any particular binarization coding information or to any particular way of portraying such information. For ease of explanation, the binarization coding information 800 of Figure 8 may be described as being used by the apparatus 300 of Figure 3, such as during encoding / decoding operations. However, the binarization coding information 800 may be used with any other suitable system and any other suitable electronic device.
[0144] In an embodiment of the disclosure, as shown in Figure 8, this disclosure provides for adding an offset to the fixed length decoded value to generate the final decoded value and avoid unused code words. The use of the offset in obtaining the final decoded value is detailed further below. The apparatus may determine a final value based on adding an offset to the value associated with mesh handle. Meanwhile, the final decoded value may refer to the final value. And, the fixed length decoded value may refer to the value associated with mesh handle.
[0145] In an embodiment, to further increase the coding efficiency, the number of bits in each code word group is reduced while implementing an offset in determining the final decoded value. For example, in various embodiments, the syntax element of mesh_handle_X_variable_delta_length4_minus1 may be changed to mesh_handle_X_variable_delta_length3_minus1. The number of bits may be a multiple of three.
[0146] When N = 3, the following syntax elements shown in Table 3 may be used.
[0147]
[0148] [Table 3]
[0149] In an embodiment of the disclosure, mesh_handle_first_variable_delta_length3_minus1[ i ] specifies the number of groups of three bits used to represent mesh_handle_first_variable_delta[ i ]. mesh_handle_second_variable_delta_length3_minus1[ i ] specifies the number of groups of three bits used to represent mesh_handle_first_variable_delta[ i ]. mesh_handle_X_variable_delta_length3_minus1 may refer to as a variable having a length value defining a number of bits for codewords for the value associated with the mesh handle. The variable further may specify a number of groups of N bits used to represent the value associated with mesh handle. This is shown in Figures 9 and 10.
[0150] Figure 9 illustrates example binarization coding information 900 where groups of 3 bits are used to represent the mesh handle information(e.g., mesh_handle_X_variable_delta), but no offset is used, leading again to unused codewords. Figure 9 shows the corresponding binarization. The number of bins used for mesh_handle_X_variable_delta is 3 * (mesh_handle_X_variable_delta_length3_minus1 + 1).
[0151] Figure 10 illustrates example binarization coding information 1000 using groups of 3 bits, and also using an offset, in accordance with this disclosure. The binarization coding information 1000 illustrated in Figure 10 is for illustration only. Figure 10 does not limit the scope of this disclosure to any particular binarization coding information or to any particular way of portraying such information. For ease of explanation, the binarization coding information 1000 of Figure 10 may be described as being used by the apparatus 300 of Figure 3, such as during encoding / decoding operations. However, the binarization coding information 1000 may be used with any other suitable system and any other suitable electronic device.
[0152] As mentioned, it may be seen from Figures 7 and 9 that unused codewords lead to loss in compression efficiency. In embodiments of this disclosure, as shown in Figures 8 and 10, the values coded are modified such that there are no unused codewords. An offset is added to the fixed length decoded value to generate the final decoded value and avoid unused code words. Figures 8 and 10 demonstrate that offsets may be used for different numbers of bits, e.g., 4 or 3 in these examples.
[0153] In an embodiment of the disclosure, as shown in Figures 8 and 10, the offsets are applied to fixed length decoded values to obtain a final decoded value. For example, in an embodiment, let N be equal to the number of bits grouped to generate or determine mesh_handle_first_variable_delta and mesh_handle_second_variable_delta (indicated as mesh_handle_X_variable_delta). Let mesh_handle_X_variable_delta_lengthN_minus1 specifies the number of groups of N bits used to represent mesh_handle_X_variable_delta[ i ].
[0154] In the encoder, the following pseudo-code illustrates how to generate or determine the mesh_handle_X_variable_delta_lengthN_minus1 and mesh_handle_X_variable_delta values. HND_DELTA_LENGTH_N_MAX is the maximum possible value of mesh_handle_X_variable_delta_lengthN_minus1.
[0155]
[0156] HND_OFFSET[0] = 0, HND_OFFSET[i] for other values if “i” is given by:
[0157]
[0158] In the decoder, the decoder obtains the final decoded value by adding the offset to the fixed length decoded value. For instance, in the decoder, let nb be the decoded value of mesh_handle_X_variable_delta_lengthN_minus1.
[0159] Let val be set to the fixed length decoded value of mesh_handle_X_variable_delta. The final value of mesh_handle_X_variable_delta is calculated by adding an offset as follows:
[0160] val = val + HND_OFFSET[nb - 1]
[0161] In an embodiment of the disclosure, there are no unused codewords, increasing coding efficiency. This if further illustrated by the following. In various embodiemnts, the following pseudo-code is used to convert the syntax elements mesh_handle_first_variable_delta[i], mesh_handle_second_variable_delta[i], mesh_handle_first_variable_delta_length3_minus1[i], mesh_handle_second_variable_delta_length3_minus1[i] into handle information (HandlesArray[][]). Let a 2D array HandlesArray, of size mesh_handles_count Х 2, specifying for each handle two associated corner indices, be derived as follows:
[0162] Let the variables handleFirst, handleSecond, firstSign and secondSign be initialized to 0
[0163]
[0164] In an embodiment, Table 4 below showing MPEG EdgeBreaker syntax element specific parsing processes (ae(v)) includes modified syntax elements for mesh_handle_first_variable_delta_length3_minus1[i] and mesh_handle_first_variable_delta_length3_minus1[i], where these syntax elements are binarized with a truncated unary code with maxVal = 10 as specified. mesh_handle_first_variable_delta[i] is binarized as a fixed length code with a length of 3*(mesh_handle_first_variable_delta_length3_minus1[i]+ 1). mesh_handle_second_variable_delta[i] is binarized as a fixed length code with a length of 3*(mesh_handle_second_variable_delta_length3_minus1[i]+ 1).
[0165]
[0166] In an embodiment, when N = 3, depending on the value of HND_DELTA_LENGTH_3_MAX, the number of iterations in the encoder may be large. Thus, in various embodiments of this disclosure, a mix of the use of fixed length coding and arithmetic coding using offsets may be performed to limit the maximum number of iterations. For example, Figure 11 shows the corresponding binarization. Figure 11 illustrates example binarization coding information 1100 using a maximum number of offsets, in accordance with this disclosure. The binarization coding information 1100 illustrated in Figure 11 is for illustration only. Figure 11 does not limit the scope of this disclosure to any particular binarization coding information or to any particular way of portraying such information. For ease of explanation, the binarization coding information 1100 of Figure 11 may be described as being used by the apparatus 300 of Figure 3, such as during encoding / decoding operations. However, the binarization coding information 1100 may be used with any other suitable system and any other suitable electronic device.
[0167] In the example of Figure 11, the maximum number of offsets is set to five, although it will be understood that the maximum offset may be set to other values. As shown in Figure 11, offsets are used for the first five value rows of the binarization coding information 1100. Once the sixth row is reached, and the codewords thus include 6 groups of 3-bits, no offset is used and direct fixed length coding is used. Although, as shown in Figure 11, this results in some unused codewords, this still allows for previous coding to avoid unused codewords, while also decreasing the number of iterations to process the data, leading to an overall improvement in coding and transmission efficiency.
[0168] In various embodiments such as in Figure 11 where a mix of the use of fixed length coding and arithmetic coding is used, the following pseudo-code is used in the encoder to generate the values of mesh_handle_X_variable_delta_length3_minus1 and mesh_handle_X_variable_delta:
[0169]
[0170] In an embodiment of the disclosure, only arithmetic coding may be utilized to code the value associated with mesh handle. And, a minimum amount of handles may be set to zero.
[0171] In an embodiment, in the decoder, let nb be the decoded value of mesh_handle_X_variable_delta_length3_minus1. Let val be set to the fixed length decoded value of mesh_handle_X_variable_delta. The final value of mesh_handle_X_variable_delta is calculated by adding an offset when (nb < HND_MAX_NUM_OFFSET). If (nb >= HND_MAX_NUM_OFFSET), then no offset is added. This may be represented by the following pseudo-code:
[0172]
[0173] Figure 12 illustrates an example encoding method 1200 in accordance with this disclosure. For ease of explanation, the method 1200 of Figure 12 is described as being performed using the apparatus 300 of Figure 3. However, the method 1200 may be used with any other suitable system and any other suitable electronic device.
[0174] In an embodiment of the disclosure, as shown in Figure 12, at step 1202, and as also described with respect to Figures 4-11, the apparatus 300 may obtain a value associated with a mesh handle of a base mesh. At step 1204, the apparatus 300 may determine a coded value based on subtracting an offset from the value associated with the mesh handle of the base mesh. The apparatus may subtract an offset from the value to generate a coded value. The coded value is generated for inclusion in a compressed bitstream. As described in this disclosure, the apparatus 300 may also, as part of creating the compressed bitstream, include in the mesh handle information a variable having a length value defining a number of bits for codewords and a value range for the coded value. In an embodiment, the number of bits is a multiple of three. In an embodiment, , as described in this disclosure, the variable further specifies a number of groups of N bits used to represent a mesh handle variable delta. In an embodiment, as described in this disclosure, the apparatus 300 may also generate a plurality of coded values using a plurality of offsets. In an embodiment, as described in this disclosure, a limit is imposed on a determined number of the plurality of offsets to prevent processing of iterations beyond the determined number.
[0175] In an embodiment of the disclosure, at step 1206, the apparatus 300 may generate a bitstream including the coded value. The apparatus 300 may create the compressed bitstream including the mesh handle information and the coded value. As described in this disclosure, the compressed bitstream may be multiplexed to include sub-bitstreams such as an atlas sub-bitstream, a base-mesh sub-bitstream, a displacement sub-bitstream, and an attribute sub-bitstream. In an embodiment, as described in this disclosure, only arithmetic coding is utilized to code the mesh handle information, where a minimum amount of handles is set to zero. The output compressed bitstream may be transmitted to an external device or to a storage on the apparatus 300.
[0176] Although Figure 12 illustrates one example of an encoding method 1200, various changes may be made to Figure 12. For example, while shown as a series of steps, various steps in Figure 12 may overlap, occur in parallel, or occur any number of times. It will be understood that the method 1200 may be used with any number of coded values and any number of offsets, and the method 1200 as described is merely for illustrative purposes.
[0177] Figure 13 illustrates an example decoding method 1300 in accordance with this disclosure. For ease of explanation, the method 1300 of Figure 13 is described as being performed using the apparatus 300 of Figure 3. However, the method 1300 may be used with any other suitable system and any other suitable electronic device.
[0178] In an embodiment of the disclosure, as shown in Figure 13, at step 1302, the apparatus 300 may obtain a bitstream comprising a base mesh sub-bitstream including a value associated with mesh handle. The apparatus may receive a compressed bitstream including a base mesh sub-bitstream, the base mesh sub-bitstream including mesh handle information. In an embodiment, as described in this disclosure, only arithmetic coding is utilized to code the mesh handle information, wherein a minimum amount of handles is set to zero. the apparatus 300 decodes at least a portion of the compressed bitstream.
[0179] In an embodiment of the disclosure, at step 1304, the apparatus 300 may determine a final value based on adding an offset to the value associated with mesh handle. The apparatus 300 may modify at least one coded value from the decoded portion of the compressed bitstream. The at least one coded value is modified based on adding an offset to a fixed length decoded value to generate a final decoded value. As described in this disclosure, this modification reduces an amount of unused codewords.
[0180] In an embodiment of the disclosure, as described in this disclosure, the mesh handle information in the base mesh sub-bitstream may include a variable having a length value defining a number of bits for codewords and a value range for the fixed length decoded value used to generate the final decoded value. The bitstream may include a variable having a length value defining a number of bits for codewords for the value used to generate the final value. In an embodiment, as described in this disclosure, the number of bits is a multiple of three. In an embodiment, as described in this disclosure, the variable further specifies a number of groups of N bits used to represent a mesh handle variable delta.
[0181] In an embodiment of the disclosure, it is determined whether a limit on the number of offsets is imposed. For example, in an embodiment, as described in this disclosure, the apparatus 300 may generate a plurality of final decoded values using a plurality of fixed length decoded values by adding one of a plurality of offsets to one of the plurality of fixed length decoded values. A limit may be imposed on a determined number of the plurality of offsets to prevent processing of iterations beyond the determined number.
[0182] If, it is determined that no limit is imposed on the number of offsets, the method 1300 moves to step 1306. If, however, it is determined that a limit is imposed on the number of offsets, the apparatus 300 determines that an iteration meets or exceeds the limit and processes at least one of the plurality of fixed length decoded values without adding an offset. The method 1300 then moves to step 1306.
[0183] In an embodiment of the disclosure, at step 1306, the apparatus 300 reconstructs a base mesh using the final decoded value. The apparatus 300 outputs decoded content using the reconstructed base mesh, such as 3D video including a reconstructed mesh-frame. The output decoded content may be transmitted to an external device or to a storage on the apparatus 300, for instance.
[0184] Although Figure 13 illustrates one example of a decoding method 1300, various changes may be made to Figure 13. For example, while shown as a series of steps, various steps in Figure 13 may overlap, occur in parallel, or occur any number of times. It will be understood that the method 1300 may be used with any number of coded values and any number of offsets, and the method 1300 as described is merely for illustrative purposes.
[0185] In an embodiment of the disclosure, an apparatus 300 for decoding base-mesh is provided. The apparatus 300 may comprise at least one memory 360 storing one or more instructions, and one or more processors 340 including processing circuitry. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to obtain a bitstream comprising a base mesh sub-bitstream including a value associated with mesh handle. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to determine a final value based on adding an offset to the value associated with mesh handle. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to reconstruct a base mesh using the final value.
[0186] In an embodiment of the disclosure, the bitstream includes a variable having a length value defining a number of bits for codewords for the value used to generate the final value.
[0187] In an embodiment of the disclosure, the number of bits is a multiple of three.
[0188] In an embodiment of the disclosure, the variable further specifies a number of groups of N bits used to represent the value associated with mesh handle.
[0189] In an embodiment of the disclosure, only arithmetic coding is utilized to code the value associated with mesh handle, wherein a minimum amount of handles is set to zero.
[0190] In an embodiment of the disclosure, the one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to generate a plurality of final values using a plurality of values by adding one of a plurality of offsets to one of the plurality of the values.
[0191] In an embodiment of the disclosure, a limit is imposed on a determined number of the plurality of offsets to prevent processing of iterations beyond the determined number.
[0192] In an embodiment of the disclosure, the one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to determine that an iteration meets or exceeds the limit. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to process at least one of the plurality of the values without adding an offset.
[0193] In an embodiment of the disclosure, an apparatus 300 for encoding base-mesh is provided. The apparatus 300 may include at least one memory 360 storing one or more instructions; and one or more processors 340 including processing circuitry. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to obtain a value associated with a mesh handle of a base mesh. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to determine a coded value based on subtracting an offset from the value associated with the mesh handle of the base mesh. The one or more instructions may be executed by the one or more processors individually or collectively, to cause the apparatus to generate a bitstream including the coded value.
[0194] In an embodiment of the disclosure, the bitstream includes a variable having a length value defining a number of bits for codewords for the coded value in the bitstream.
[0195] In an embodiment of the disclosure, the number of bits is a multiple of three.
[0196] In an embodiment of the disclosure, the variable further specifies a number of groups of N bits used to represent the coded value.
[0197] In an embodiment of the disclosure, only arithmetic coding is utilized to code the coded value, wherein a minimum amount of handles is set to zero.
[0198] In an embodiment of the disclosure, the one or more instructions executed by the one or more processors individually or collectively, to cause the apparatus to generate a plurality of coded values using a plurality of offsets, and wherein a limit is imposed on a determined number of the plurality of offsets to prevent processing of iterations beyond the determined number.
[0199] In an embodiment of the disclosure, a method for transmitting the bitstream generated by an apparatus 300 for encoding base-mesh is provided. The method may include obtain a value associated with a mesh handle of a base mesh 1202. The method may include determine a coded value based on subtracting an offset from the value associated with the mesh handle of the base mesh 1204. The method may include generate the bitstream including the coded value 1206.
[0200] Although the present disclosure has been described with exemplary embodiments, various changes and modifications may be suggested to one skilled in the art. It is intended that the present disclosure encompass such changes and modifications as fall within the scope of the appended claims. None of the description in this application should be read as implying that any particular element, step, or function is an essential element that must be included in the claims scope. The scope of patented subject matter is defined by the claims.
Claims
An apparatus (300) for decoding base-mesh comprising:at least one memory (360) storing one or more instructions; andone or more processors (340) including processing circuitry, wherein the one or more instructions executed by the one or more processors individually or collectively, to cause the apparatus to:obtain a bitstream comprising a base mesh sub-bitstream including a value associated with mesh handle;determine a final value based on adding an offset to the value associated with mesh handle; andreconstruct a base mesh using the final value.The apparatus (300) of Claim 1, wherein the bitstream includes a variable having a length value defining a number of bits for codewords for the value used to generate the final value.The apparatus (300) of Claim 2, wherein the number of bits is a multiple of three.The apparatus (300) of any one of Claims 2 to 3, wherein the variable further specifies a number of groups of N bits used to represent the value associated with mesh handle.The apparatus (300) of any one of Claims 1 to 4, wherein only arithmetic coding is utilized to code the value associated with mesh handle, wherein a minimum amount of handles is set to zero.The apparatus (300) of any one of Claims 1 to 5, wherein the one or more instructions executed by the one or more processors individually or collectively, to cause the apparatus to:generate a plurality of final values using a plurality of values by adding one of a plurality of offsets to one of the plurality of the values.The apparatus (300) of Claim 6, wherein a limit is imposed on a determined number of the plurality of offsets to prevent processing of iterations beyond the determined number.The apparatus (300) of Claim 7, wherein the one or more instructions executed by the one or more processors individually or collectively, to cause the apparatus to:determine that an iteration meets or exceeds the limit; andprocess at least one of the plurality of the values without adding an offset.An apparatus (300) for encoding base-mesh comprising:at least one memory (360) storing one or more instructions; andone or more processors (340) including processing circuitry, wherein the one or more instructions executed by the one or more processors individually or collectively, to cause the apparatus to:obtain a value associated with a mesh handle of a base mesh;determine a coded value based on subtracting an offset from the value associated with the mesh handle of the base mesh; andgenerate a bitstream including the coded value.The apparatus (300) of Claim 9, wherein the bitstream includes a variable having a length value defining a number of bits for codewords for the coded value in the bitstream.The apparatus (300) of Claim 10, wherein the number of bits is a multiple of three.The apparatus (300) of any one of Claims 10 to 11, wherein the variable further specifies a number of groups of N bits used to represent the coded value.The apparatus (300) of any one of Claims 9 to 12, wherein only arithmetic coding is utilized to code the coded value, wherein a minimum amount of handles is set to zero.The apparatus (300) of any one of Claims 9 to 13, wherein the one or more instructions executed by the one or more processors individually or collectively, to cause the apparatus to:generate a plurality of coded values using a plurality of offsets, and wherein a limit is imposed on a determined number of the plurality of offsets to prevent processing of iterations beyond the determined number.A method for transmitting the bitstream generated by an apparatus (300) for encoding base-mesh, the method comprising:obtain a value associated with a mesh handle of a base mesh (1202);determine a coded value based on subtracting an offset from the value associated with the mesh handle of the base mesh (1204); andgenerate the bitstream including the coded value (1206).
Citation Information
Patent Citations
Method and apparatus for encoding / decoding 3D mesh information
US20090263029A1
An apparatus, a method and a computer program for video coding and decoding
US20210258659A1
Encoding method, decoding method, encoder and decoder
WO2024091860A1
Heterogeneous mesh autoencoders
WO2024102920A1