Decrypting Tile Hash SEI Message for V3C / V-PCC
The introduction of a hash SEI message for V3C/V-PCC Atlas frames addresses the issue of data mismatch in point cloud compression, ensuring accurate decoding and reconstruction of 3D graphics by verifying decoded content against the original encoded data.
Patent Information
- Application Number
- JP2022579783
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-01-28
- Filing Date
- 2021-06-20
- Publication Date
- 2024-11-06
- Estimated Expiration
- 2041-06-20
AI Technical Summary
Existing point cloud compression techniques for 3D graphics lack a reliable method to ensure that the decoded data matches the original encoded data, particularly in dynamic 3D scenes, leading to potential decoding errors and improper reconstruction.
A new hash supplemental enhancement information (SEI) message is introduced for V3C/V-PCC Atlas frames, using hash values computed for syntax elements associated with each patch, enabling verification of decoded content against the original encoded data.
Ensures accurate decoding and reconstruction of 3D graphics by verifying the decoded content using hash information, enhancing conformance testing and decoding accuracy.
Smart Images

Figure 0007578147000029 
Figure 0007578147000030 
Figure 0007578147000031
Abstract
Description
[Technical field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority under 35 U.S.C. § 119 to U.S. Provisional Patent Application No. 63 / 046,749, filed July 1, 2020, and entitled “DECODED TILE HASH SEI MESSAGE FOR V3C / V-PCC,” U.S. Provisional Patent Application No. 63 / 045,272, filed June 29, 2020, and entitled “DECODED TILE HASH SEI MESSAGE FOR V3C / V-PCC,” U.S. Provisional Patent Application No. 63 / 044,430, filed June 26, 2020, and entitled “DECODED TILE HASH SEI MESSAGE FOR V3C / V-PCC,” all of which are incorporated herein by reference in their entireties for all purposes.
[0002] The present invention relates to three-dimensional graphics, and more particularly to coding of three-dimensional graphics. [Background technology]
[0003] Recently, a novel method for compressing point clouds based on 3D to 2D projection has been standardized. This method, also known as V-PCC (Video-Based Point Cloud Compression), maps 3D point cloud data into multiple 2D patches, which are then placed into an atlas image, which is then encoded by a video encoder. The atlas image corresponds to the geometry of the points, their respective textures, and an occupancy map that indicates which locations should be considered for point cloud reconstruction.
[0004] In 2017, MPEG issued a Call for Proposals (CfP) for the compression of point clouds. After evaluating multiple proposals, MPEG is currently considering two different point cloud compression techniques: a 3D native encoding technique (based on octree and similar encoding methods) or a 3D to 2D projection followed by traditional video encoding. For dynamic 3D scenes, MPEG is using a test model software (TMC2) based on patch surface modeling, projection of the patches from 3D to a 2D image, and encoding of the 2D image using a video encoder such as HEVC. This method has been proven to be more efficient than native 3D encoding and to achieve competitive bitrates with acceptable quality. Summary of the Invention [Problem to be solved by the invention]
[0005] This document describes a new hash supplemental enhancement information (SEI) message for V3C / V-PCC atlas frames. This message is used to signal a hash value that is calculated for the syntax elements associated with each patch. The hash SEI message can be used for V3C / V-PCC tile level and, optionally, for atlas level conformance testing. The hash can be used to verify that the value decoded by the decoder is the same as the original value encoded by the encoder. [Means for solving the problem]
[0006] In one aspect, a method includes encoding point cloud content to generate encoded point cloud content, generating and transmitting hash information, decoding the encoded point cloud content, and verifying the decoded content using the hash information. The encoding of the point cloud content includes using a V-PCC encoding implementation that compresses the point cloud based on a 3D to 2D projection, and the encoding of the point cloud content includes mapping 3D point cloud data to a number of 2D patches and placing the patches in an atlas image, which corresponds to the geometry of the points, their respective textures, and an occupancy map indicating which locations should be considered for point cloud reconstruction. The hash information is generated using syntax elements and / or variable values of the point cloud content. The hash information is transmitted for an atlas. The hash information is transmitted for a block to patch of an atlas. The hash information is transmitted for a tile. The hash information is transmitted for a block to patch of a tile. The hash information is transmitted in a supplemental enhancement information (SEI) message. The SEI message includes tile-based "BlockToPatchMap[ ][ ]" hash value information. The hash information is generated using an implementation selected from the group consisting of MD5, CRC, and checksum.
[0007] In another aspect, an apparatus comprises a non-transitory memory for storing an application for receiving encoded point cloud content, receiving hash information, decoding the encoded point cloud content, and verifying the decoded content using the hash information, and a processor coupled to the memory and configured to process the application. The hash information is generated using syntax elements and / or variable values of the point cloud content. The hash information is sent for an atlas. The hash information is sent for atlas block to patch. The hash information is sent for tiles. The hash information is sent for tile block to patch. The hash information is sent in a Supplemental Enhancement Information (SEI) message. The SEI message includes tile-based “BlockToPatchMap[ ][ ]” hash value information. The hash information is generated using an implementation selected from the group consisting of MD5, CRC, and checksum.
[0008] In another aspect, a system includes one or more cameras for capturing three-dimensional content, an encoder for encoding the three-dimensional content to generate encoded point cloud content and generating and transmitting hash information, and a decoder for decoding the encoded point cloud content and verifying the decoded content using the hash information. The encoding of the three-dimensional content includes using a V-PCC encoding implementation that compresses the three-dimensional content based on a 3D to 2D projection, and the encoding of the three-dimensional content includes mapping 3D point cloud data into a number of 2D patches and placing the patches in an atlas image, which corresponds to the geometry of the points, their respective textures, and an occupancy map indicating which locations should be considered for point cloud reconstruction, and the hash information is generated using syntax elements and / or variable values of the three-dimensional content. The hash information is transmitted for an atlas. The hash information is transmitted for a block to patch of an atlas. The hash information is transmitted for a tile. The hash information is transmitted for a block to patch of a tile. The hash information is transmitted in a supplemental enhancement information (SEI) message. The SEI message includes tile-based "BlockToPatchMap[ ][ ]" hash value information. The hash information is generated using an implementation selected from the group consisting of MD5, CRC, and checksum. [Brief description of the drawings]
[0009] [Figure 1] 1 is a flowchart of a method for encoding and decoding content according to some embodiments. [Diagram 2] 1 is a flowchart for generating a hash according to some embodiments. [Diagram 3] FIG. 1 is a diagram of a system configured to implement hashing, according to some embodiments. [Figure 4] FIG. 1 is a block diagram of an example computing device configured to implement a decryption tile hash SEI message, according to some embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] This document describes a new hash supplemental enhancement information (SEI) message for V3C / V-PCC atlas frames. This message is used to signal hash values, computed in tile and patch scan order, for all syntax elements associated with each patch. We also assert that the hash SEI message can be used for V3C / V-PCC tile level and, optionally, for atlas level conformance testing.
[0011] The hash can be used to verify that the value decoded by the decoder is the same as the original value encoded by the encoder.
[0012] Decrypt Atlas Information Hash SEI Message It has been noted that a decoder that can correctly determine the "BlockToPatchMap[ ][ ]" information may not be able to properly decode other information that is important for point cloud reconstruction. This specification describes an atlasinfohash SEI message that includes an option to include tile-based "BlockToPatchMap[ ][ ]" hash value information. This combination ensures proper decoding of block-to-volume information and reconstruction of the volumetric box corresponding to the 2D to 3D patch transformation.
[0013] Syntax of Decode Atlas Information Hash SEI Message Table 1 shows the syntax structure of the decoded atlas information hash SEI message. It is a suffix SEI message, carried in a NAL unit of type NAL_SUFFIX_SEI, and its payloadType value is set to 21. The main use of the decoded atlas information hash SEI message is for debugging purposes and for conformance testing of atlas decoders. Options for both atlas-based and tile-based hash value calculation are provided. This is done by going through all tiles in the atlas and all elements associated with each patch in the tile. As an example, for non-EOM and RAW patches, the variables Patch2dPosX[p], Patch2dPosY[p], Patch2dSizeX[p], Patch2dSizeY[p], Patch3dPosX[p], Patch3dPosY[p], Patch3dPosMinZ[p], PatchOrientationIndex[p], PatchLoDScaleX[p], and PatchLoDScaleY[p] should be processed in a pre-specified order, with tiles followed by patches in coding order. A similar approach can be taken for EOM / RAW patches, depending on whether they are associated with normal or auxiliary streams. Several high-level variables / syntax elements are included that are used as "frame headers" for checksum calculation of atlas-based hash messages.
[0014] Syntax of Decoded Atlas Information Hash SEI [Table 1] TIFF0007578147000002.tif250162 TIFF0007578147000003.tif79167
[0015] Semantics of the Decode Atlas Information SEI Message The semantics of the fields of the Decode Atlas Info Hash SEI message are as follows:
[0016] First, we assume that all syntax elements are stored as unsigned 16-bit numbers. The derivation of the atlas-level hash values, starting from the high-level syntax variables, is shown as follows:
[0017] TIFF0007578147000004.tif249164 TIFF0007578147000005.tif250162 TIFF0007578147000006.tif249170 TIFF0007578147000007.tif243170 TIFF0007578147000008.tif249168 TIFF0007578147000009.tif212170
[0018] Similarly, for atlas-based BlockToPatch[ ][ ], TIFF0007578147000010.tif102164
[0019] The derivation of the tile-based hash value is shown as follows: TIFF0007578147000011.tif243170 TIFF0007578147000012.tif248163 TIFF0007578147000013.tif251169 TIFF0007578147000014.tif203170
[0020] For tile-based BlockToPatch[ ][ ], the atlasB2pData[ ] array is generated as follows: TIFF0007578147000015.tif117164
[0021] daih_hash_type indicates the method used to compute the checksum according to Table 2 below. Values of daih_hash_type not listed in the table are reserved for future use by ITU-T|ISO / IEC and shall not be present in bitstreams conforming to this version of this specification. Decoders shall ignore decoded picture hash SEI messages that contain reserved hash_type values.
[0022] Atlas Hash Type [Table 2]
[0023] If daih_decoded_atlas_hash_present_flag is equal to 1, it specifies that the daih_atlas_md5[i], daih_atlas_crc, or daih_atlas_checksum syntax elements are present. If daih_decoded_atlas_hash_present_flag is equal to 0, it specifies that the daih_atlas_md5[i], daih_atlas_crc, or daih_atlas_checksum syntax elements are not present.
[0024] Specifies that the daih_atlas_b2p_md5[i], daih_atlas_b2p_crc, or daih_atlas_b2p_checksum syntax elements are present if daih_decoded_atlas_b2p_hash_present_flag is equal to 1. Specifies that the daih_atlas_b2p_md5[i], daih_atlas_b2p_crc, or daih_atlas_b2p_checksum syntax elements are not present if daih_decoded_atlas_b2p_hash_present_flag is equal to 0.
[0025] Specifies that the daih_atlas_tiles_md5[i], daih_atlas_tiles_crc, or daih_atlas_tiles_checksum syntax elements are present when daih_decoded_atlas_tiles_hash_present_flag is equal to 1. Specifies that the daih_atlas_tiles_md5[i], daih_atlas_tiles_crc, or daih_atlas_tiles_checksum syntax elements are not present when daih_decoded_atlas_tiles_hash_present_flag is equal to 0.
[0026] Specifies that the daih_atlas_tiles_b2p_md5[i], daih_atlas_tiles_b2p_crc, or daih_atlas_tiles_b2p_checksum syntax elements are present if daih_atlas_tiles_b2p_hash_present_flag is equal to 1. Specifies that the daih_atlas_tiles_b2p_md5[i], daih_atlas_tiles_b2p_crc, or daih_atlas_tiles_b2p_checksum syntax elements are not present if daih_atlas_tiles_b2p_hash_present_flag is equal to 0.
[0027] daih_atlas_md5[i] is the 16-byte MD5 hash of the decryption atlas associated with vuh_atlas_id. The value of daih_atlas_md5[i] is equal to the value of digestVal, which is obtained using the MD5 function defined in IETF RFC 1321 as follows: TIFF0007578147000017.tif2877
[0028] daih_atlas_crc is the Cyclic Redundancy Check (CRC) of the decoding atlas associated with vuh_atlas_id. The value of daih_atlas_crc is equal to the value of crcVal, which is obtained using the CRC specification defined in Rec. ITU-T H.271 as follows: TIFF0007578147000018.tif79135
[0029] daih_atlas_checksum is the checksum of the decryption atlas associated with vuh_atlas_id. The value of daih_atlas_checksum is equal to the value of checksumVal, which is obtained as follows: TIFF0007578147000019.tif72165
[0030] daih_atlas_b2p_md5[i] is the 16-byte MD5 hash of the BlockToPatch[ ][ ] of the atlas associated with vuh_atlas_id. The value of daih_atlas_b2p_md5[i] is equal to the value of digestVal, which is obtained using the MD5 function defined in IETF RFC 1321 as follows: TIFF0007578147000020.tif2790
[0031] daih_atlas_b2p_crc is the Cyclic Redundancy Check (CRC) of the decoding atlas associated with vuh_atlas_id. The value of daih_atlas_b2p_crc is equal to the value of crcVal, which is obtained using the CRC specification defined in Rec. ITU-T H.271 as follows: TIFF0007578147000021.tif82138
[0032] daih_atlas_b2p_checksum is the checksum of the decryption atlas associated with vuh_atlas_id. The value of daih_atlas_b2p_checksum is equal to the value of checksumVal, which is obtained as follows: TIFF0007578147000022.tif97168
[0033] daih_num_tiles_minus1 + 1 specifies the number of tiles for which the hash value is signaled. The value of daih_num_tiles_minus1 is in the range of 0 to afti_num_tiles_in_atlas_frame_minus1.
[0034] daih_tile_id_len_minus1 + 1 specifies the number of bits used to represent the syntax element daih_tile_id[t]. The value of daih_tile_id_len_minus1 is in the range of 0 to Ceil(Log2(afti_num_tiles_in_atlas_frame_minus1+1)). The value of 1<<(daih_tile_id_len_minus1+1) is greater than or equal to daih_num_tile_minus1+1.
[0035] daih_tile_id[t] specifies the tile ID of the t-th tile. The length of the daih_tile_id[ ] syntax element is daih_tile_id_len_minus1+1 bits. If daih_tile_id[t] is not present, its value is inferred to be equal to t.
[0036] daih_atlas_tiles_md5[t][i] is the 16-byte MD5 hash of the t-th tile. The value of daih_atlas_tiles_md5[t][i] is equal to the value of digestVal, which is obtained using the MD5 function defined in IETF RFC 1321 as follows: TIFF0007578147000023.tif2791
[0037] daih_atlas_tiles_crc[t] is the Cyclic Redundancy Check (CRC) of the decoded atlas tile containing tile ID t, associated with vuh_atlas_id. The value of daih_atlas_tiles_crc is equal to the value of crcVal, which is obtained using the CRC specification defined in Rec. ITU-T H.271, as follows: TIFF0007578147000024.tif80136
[0038] daih_atlas_tiles_checksum[t] is the checksum of the decoded atlas tile containing tile ID t, associated with vuh_atlas_id. The value of daih_atlas_tile_checksum is equal to the value of checksumVal, which is obtained as follows: TIFF0007578147000025.tif66163
[0039] daih_atlas_tiles_b2p_md5[t][i] is the 16-byte MD5 hash of the t-th tile BlockToPatchMap[ ][ ]. The value of daih_blk2patch_md5[t][i] is equal to the value of digestVal[t], which is obtained using the MD5 function defined in IETF RFC 1321 as follows: TIFF0007578147000026.tif27104
[0040] daih_atlas_tiles_b2p_crc[t] is the Cyclic Redundancy Check (CRC) of the decoded atlas tile BlockToPatchMap[ ][ ] containing tile ID t, associated with vuh_atlas_id. The value of daih_atlas_tiles_b2p_crc is equal to the value of crcVal, which is obtained using the CRC specification defined in Rec. ITU-T H.271 as follows: TIFF0007578147000027.tif78135
[0041] daih_atlas_tiles_b2p_checksum[t] is the checksum of the decoded atlas tile BlockToPatchMap[ ][ ] containing tile ID t, associated with vuh_atlas_id. The value of daih_atlas_tile_checksum is equal to the value of checksumVal, which is obtained as follows: TIFF0007578147000028.tif80167
[0042] The Decoded Atlas Information Hash SEI message is described herein along with its syntax and semantics. A “BlockToPatch” hash value is also included to ensure proper decoding of the block-to-volume information at conformance point A and correct reconstruction of the volumetric data. In addition to the md5 method of checksum calculation, two other hash types are enumerated for potential extensibility: CRC and checksum. The V3C / V-PCC specification may contain sections such as Annex B to provide examples for nominal derivations of hash checksum values. As a “frame header” for checksum calculation of the hash message, Annex B may contain several variables related to the high level syntax elements used for reconstruction section H.9.
[0043] FIG. 1 shows a flow chart of a method for encoding and decoding content according to some embodiments. In step 100, the point cloud content is encoded. The encoding of the content can be implemented in any manner, such as using a V-PCC encoding implementation that compresses the point cloud based on a 3D to 2D projection. This method maps the 3D point cloud data into multiple 2D patches, and then places these patches in an atlas image, which is then encoded by a video encoder. The atlas image corresponds to the geometry of the points, their respective textures, and an occupancy map that indicates which locations should be considered for point cloud reconstruction. Two possible point cloud compression techniques from MPEG include 3D native encoding techniques (based on octree and similar encoding methods) or 3D to 2D projection followed by traditional video encoding. For dynamic 3D scenes, MPEG uses a test model software (TMC2) based on patch surface modeling, projection of the patches from 3D to 2D images, and encoding of the 2D images using a video encoder such as HEVC.
[0044] At step 102, a hash is generated and transmitted. As described herein, the hash is generated using syntax elements and / or variable values of the content. In some embodiments, the hash is transmitted for the atlas or for a block to patch of the atlas. In some embodiments, the hash is transmitted for the tile or for a block to patch of the tile. The hash is transmitted in an SEI message.
[0045] In step 104, the encoded content (the point cloud) is decoded. Any decoder can be used, such as an MPEG implementation.
[0046] The hash information is used to verify the decrypted content in step 106. The decrypted content is verified using the hash information via any hash comparison technique.
[0047] In some embodiments, fewer or additional steps may be implemented. In some embodiments, the order of the steps is changed.
[0048] FIG. 2 shows a flow chart for generating a hash, according to some embodiments. Previously, the hash is based on luminance, color and / or other pixel values. In step 200, a byte string is generated by combining values of syntax elements or other information of the content (e.g., atlas or tile). For example, for an atlas, the frame width is 2 bytes (or some other value). Then, the frame height is the next 2 bytes. Other syntax elements (of the atlas) and variable values are added to this string to generate a large string (e.g., 256 bytes). In step 202, a hash algorithm is applied to the byte string to generate a hash. The hash algorithm can be selected based on a defined variable. For example, a lookup table or database can store multiple hash algorithms or similar algorithms (e.g., cyclic redundancy check), and the selected hash algorithm is applied based on the defined variable. As described herein, a variable value of 0 corresponds to the hash algorithm MD5, a variable value of 1 corresponds to CRC, a variable value of 2 corresponds to checksum, while additional variable values can be reserved for additional hash algorithms. In some embodiments, fewer or additional steps are implemented. In some embodiments, the order of the steps is changed.
[0049] FIG. 3 illustrates a diagram of a system configured to implement hashing, according to some embodiments. An encoder 300 is configured to implement an encoding process. Any encoding, such as V-PCC encoding, may be implemented using one or more MPEG implementations as described herein. Additionally, the encoder generates hash information to be communicated with the encoded content. The encoded information and hash information may be communicated to a decoder 304 directly or through a network 302. The network may be any type of network, such as a local area network (LAN), the Internet, a wireless network, a wired network, a cellular network, and / or any other network or combination of networks. The decoder 304 decodes the encoded content and uses the hash information to verify the decoded content.
[0050] FIG. 4 illustrates a block diagram of an exemplary computing device configured to implement the decoded tile hash SEI message, according to some embodiments. The computing device 400 can be used to acquire, store, compute, process, communicate, and / or display information, such as images and videos, including 3D content. The computing device 400 can implement any of the encoding / decoding aspects. In general, a hardware structure suitable for implementing the computing device 400 includes a network interface 402, a memory 404, a processor 406, an I / O device 408, a bus 410, and a storage device 412. The selection of the processor is not critical as long as a suitable processor with sufficient speed is selected. The memory 404 can be any conventional computer memory known in the art. The storage device 412 can include a hard drive, a CDROM, a CDRW, a DVD, a DVDRW, a high definition disk / drive, an ultra high definition drive, a flash memory card, or any other storage device. The computing device 400 can include one or more network interfaces 402. An example of a network interface includes a network card connected to an Ethernet or other type of LAN. The I / O devices 408 may include one or more of the following: a keyboard, a mouse, a monitor, a screen, a printer, a modem, a touch screen, a button interface, and other devices. A decryption tile hash SEI message application 430 used to implement the decryption tile hash SEI message is likely stored in the storage 412 and memory 404 and processed as an application is normally processed. The computing device 400 may include more or fewer components than those shown in FIG. 4. In some embodiments, a decryption tile hash SEI message hardware 420 is included. Although the computing device 400 of FIG. 4 includes an application 430 and hardware 420 for the decryption tile hash SEI message, the decryption tile hash SEI message may be implemented in the computing device as hardware, firmware, software, or any combination thereof.For example, in some embodiments, the decryption tile hash SEI message application 430 is programmed into a memory and executed using a processor. In another example, in some embodiments, the decryption tile hash SEI message hardware 420 is programmed hardware logic that includes gates that are specifically designed to implement the decryption tile hash SEI message.
[0051] In some embodiments, the decryption tile hash SEI message application 430 includes multiple applications and / or modules. In some embodiments, a module also includes one or more sub-modules. In some embodiments, fewer or additional modules may be included.
[0052] Examples of suitable computing devices include a personal computer, a laptop computer, a computer workstation, a server, a mainframe computer, a handheld computer, a personal digital assistant, a cellular / mobile phone, a smart appliance, a game console, a digital camera, a digital camcorder, a camera phone, a smartphone, a portable music player, a tablet computer, a mobile device, a video player, a video disc writer / player (e.g., DVD writer / player, high definition disc writer / player, ultra high definition disc writer / player), a television, a home entertainment system, an augmented reality device, a virtual reality device, smart jewelry (e.g., a smart watch), a vehicle (e.g., a self-driving vehicle), or any other suitable computing device.
[0053] To utilize the decode tile hash SEI message, a device acquires or receives 3D content (e.g., point cloud content) and processes and / or transmits the content with an SEI message that includes hash information to ensure that the 3D content is properly decoded. The decode tile hash SEI message can be implemented with user assistance or automatically without user involvement.
[0054] In operation, the decode tile hash SEI message enables more efficient and more accurate 3D content encoding compared to conventional implementations.
[0055] Several embodiments of a decoded tile hash SEI message for V3C / V-PCC 1. encoding point cloud content to generate encoded point cloud content; generating and transmitting hash information; decoding the encoded point cloud content; verifying the decrypted content using the hash information; The method includes:
[0056] 2. The method of claim 1, wherein the step of encoding the point cloud content includes using a V-PCC encoding implementation that compresses the point cloud based on a 3D to 2D projection, and the step of encoding the point cloud content includes mapping the 3D point cloud data into a number of 2D patches, placing the patches into an atlas image, and then encoding with a video encoder, the atlas image corresponding to the geometry of the points, their respective textures, and an occupancy map indicating which locations should be considered for point cloud reconstruction.
[0057] 3. The method of claim 1, wherein the hash information is generated using syntax elements and / or variable values of the point cloud content.
[0058] 4. The method of claim 1, wherein the hash information is transmitted to an atlas.
[0059] 5. The method of claim 1, wherein the hash information is sent to an atlas block to patch.
[0060] 6. The method of claim 1, wherein the hash information is transmitted to a tile.
[0061] 7. The method according to claim 1, wherein the hash information is transmitted for a block to patch of a tile.
[0062] 8. The method of claim 1, wherein the hash information is transmitted in a supplemental enhancement information (SEI) message.
[0063] 9. The method of claim 8, wherein the SEI message includes tile-based “BlockToPatchMap[ ][ ]” hash value information.
[0064] 10. The method of claim 1, wherein the hash information is generated using an implementation selected from the group consisting of MD5, CRC and checksum.
[0065] 11. Receive the encoded point cloud content; Receive the hash information, Decoding the encoded point cloud content; verifying the decrypted content using the hash information; a non-transitory memory for storing an application for a processor coupled to the memory and configured to process the application; An apparatus comprising:
[0066] 12. The apparatus of claim 11, wherein the hash information is generated using syntax elements and / or variable values of the point cloud content.
[0067] 13. The apparatus of claim 11, wherein the hash information is transmitted to an atlas.
[0068] 14. The apparatus of claim 11, wherein the hash information is transmitted to a block to patch of an atlas.
[0069] 15. The apparatus of claim 11, wherein the hash information is transmitted to a tile.
[0070] 16. The apparatus of claim 11, wherein the hash information is transmitted for a block to patch of a tile.
[0071] 17. The apparatus of claim 11, wherein the hash information is transmitted in a supplemental enhancement information (SEI) message.
[0072] 18. The apparatus of claim 17, wherein the SEI message includes tile-based “BlockToPatchMap[ ][ ]” hash value information.
[0073] 19. The apparatus of claim 11, wherein the hash information is generated using an implementation selected from the group consisting of MD5, CRC, and checksum.
[0074] 20. One or more cameras for acquiring three-dimensional content; encoding the three-dimensional content to generate encoded point cloud content; Generate and transmit hash information; and an encoder for Decoding the encoded point cloud content; verifying the decrypted content using the hash information; a decoder for A system comprising:
[0075] 21. The system described in clause 20, wherein encoding the three-dimensional content includes using a V-PCC encoding implementation that compresses the three-dimensional content based on a 3D to 2D projection, and encoding the three-dimensional content includes mapping the 3D point cloud data into a number of 2D patches and placing the patches in an atlas image, which corresponds to the geometry of the points, their respective textures, and an occupancy map indicating which locations should be considered for point cloud reconstruction.
[0076] 22. The system of claim 20, wherein the hash information is generated using syntax elements and / or variable values of the three-dimensional content.
[0077] 23. The system of claim 20, wherein the hash information is transmitted to an atlas.
[0078] 24. The system of claim 20, wherein the hash information is sent to an atlas block to patch.
[0079] 25. The system of claim 20, wherein the hash information is transmitted to a tile.
[0080] 26. The system of claim 20, wherein the hash information is transmitted for a block to patch of a tile.
[0081] 27. The system of claim 20, wherein the hash information is transmitted in a supplemental enhancement information (SEI) message.
[0082] 28. The system described in paragraph 27, wherein the SEI message includes tile-based “BlockToPatchMap[ ][ ]” hash value information.
[0083] 29. The system of claim 20, wherein the hash information is generated using an implementation selected from the group consisting of MD5, CRC, and checksum.
[0084] The present invention has been described with respect to specific embodiments incorporating details to facilitate an understanding of the principles of the construction and operation of the invention. Such references herein to specific embodiments and their details are not intended to limit the scope of the claims appended hereto. Those skilled in the art will readily appreciate that various other modifications can be made to the embodiments selected for illustration without departing from the spirit and scope of the invention as defined by the claims. [Explanation of symbols]
[0085] Encode 100 point clouds 102 Generate and send hash 104 Decode the encoded point cloud 106 Verify the decrypted point cloud using the hash Generate 200 bytes 202 Apply a hash algorithm to the byte sequence 300 Encoder 302 Network 304 Decoder 400 Computer equipment 402 Network Interface 404 Memory 406 Processor 408 I / O Devices 410 Bus 412 Storage device 420 Decryption Tile Hash SEI Message Hardware 430 Decryption Tile Hash SEI Message Application
Claims
1. encoding the point cloud content to generate encoded point cloud content; generating hash information for the atlas, the generating the hash information comprising combining values of syntax elements of the atlas including a frame width of the atlas, a frame height of the atlas and a variable value, and applying a hash algorithm to the combined values of the syntax elements, the hash algorithm being selected based on a variable defined using a lookup table for storing a plurality of hash algorithms; transmitting the hash information; decoding the encoded point cloud content; verifying the decrypted content using the hash information; The method according to claim 1, further comprising:
2. 2. The method of claim 1, wherein encoding the point cloud content includes using a V-PCC encoding implementation that compresses the point cloud based on a 3D to 2D projection, and encoding the point cloud content includes mapping the 3D point cloud data into a number of 2D patches and placing the patches in the atlas, followed by encoding with a video encoder, wherein the atlas image corresponds to the geometry of the points, their respective textures, and an occupancy map indicating which locations should be considered for point cloud reconstruction.
3. The method of claim 1 , wherein the hash information is transmitted to a block to patch of the atlas.
4. The method of claim 1 , wherein the hash information is transmitted for a tile.
5. The method of claim 1 , wherein the hash information is transmitted block to patch for a tile.
6. The method of claim 1 , wherein the hash information is transmitted in a supplemental enhancement information (SEI) message.
7. The method of claim 6 , wherein the SEI message includes tile-based “BlockToPatchMap[ ][ ]” hash value information.
8. 2. The method of claim 1, wherein the hash information is generated using an implementation selected from the group consisting of MD5, CRC, and checksum.
9. receiving the encoded point cloud content; receiving hash information for the atlas, the hash information including a frame width of the atlas, a frame height of the atlas, and a combined value of syntax elements of the atlas including a variable value; applying a hash algorithm to the combined value of syntax elements, the hash algorithm being selected based on a variable defined using a lookup table for storing a plurality of hash algorithms; Decoding the encoded point cloud content; verifying the decrypted content using the hash information; a non-transitory memory for storing an application for a processor coupled to the memory and configured to process the application; An apparatus comprising:
10. The apparatus of claim 9 , wherein the hash information is transmitted to a block to patch of the atlas.
11. The apparatus of claim 9 , wherein the hash information is transmitted for a tile.
12. The apparatus of claim 9 , wherein the hash information is transmitted block to patch of a tile.
13. The apparatus of claim 9 , wherein the hash information is transmitted in a supplemental enhancement information (SEI) message.
14. The apparatus of claim 13 , wherein the SEI message includes tile-based “BlockToPatchMap[ ][ ]” hash value information.
15. 10. The apparatus of claim 9, wherein the hash information is generated using an implementation selected from the group consisting of MD5, CRC, and checksum.
16. one or more cameras for acquiring three-dimensional content; encoding the three-dimensional content to generate encoded point cloud content; generating hash information for the atlas, the generating the hash information comprising combining values of syntax elements of the atlas including a frame width of the atlas, a frame height of the atlas and a variable value, and applying a hash algorithm to the combined values of the syntax elements, the hash algorithm being selected based on a variable defined using a lookup table for storing a plurality of hash algorithms; Transmitting the hash information. and an encoder for Decoding the encoded point cloud content; verifying the decrypted content using the hash information; a decoder for A system comprising:
17. 17. The system of claim 16, wherein encoding the three-dimensional content includes using a V-PCC encoding implementation that compresses the three-dimensional content based on a 3D to 2D projection, and encoding the three-dimensional content includes mapping 3D point cloud data into a number of 2D patches and placing the patches in the atlas followed by encoding with a video encoder, wherein the atlas image corresponds to the geometry of the points, their respective textures, and an occupancy map indicating which locations should be considered for point cloud reconstruction.
18. 17. The system of claim 16, wherein the hash information is transmitted to a block to patch of the atlas.
19. 17. The system of claim 16, wherein the hash information is transmitted to a tile.
20. 17. The system of claim 16, wherein the hash information is transmitted block to patch of a tile.
21. 20. The system of claim 16, wherein the hash information is transmitted in a supplemental enhancement information (SEI) message.
22. 22. The system of claim 21, wherein the SEI message includes tile-based "BlockToPatchMap[ ][ ]" hash value information.
23. 17. The system of claim 16, wherein the hash information is generated using an implementation selected from the group consisting of MD5, CRC, and checksum.
Citation Information
Patent Citations
Method and apparatus for identifying video decoding errors
JP2023519512A
Generic use of HEVC SEI messages for multi-layer codecs
US20150271529A1
Encoder-side decisions for block flipping and skip mode in intra block copy prediction
US20160277761A1
Network abstraction unit layer type classes in network abstraction layer unit header
US20200195946A1
Methods and apparatus to identify a video decoding error
WO2021201928A1
