Point cloud media data processing method, device, equipment, and storage medium

Abstract

The embodiments of the present application disclose a data processing method, apparatus, device, and storage medium for point cloud media. The method includes: on the one hand, obtaining point cloud data of the point cloud media, encoding the point cloud data to obtain code stream data of the point cloud media, generating attribute indication information based on the code stream data, encapsulating the code stream data and the attribute indication information, and obtaining a media file of the point cloud media. On the other hand, obtaining a media file of the point cloud media, parsing and presenting the point cloud media based on the attribute indication information and code stream data in the media file. It can be seen that the content production device describes at least two attribute components of the same type through the attribute indication information, so that the content consumption device can parse and present the point cloud media according to the attribute indication information.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method for processing point cloud media data, a device for processing point cloud media data, a computer device, and a storage medium. Background Art

[0002] With the advancement of scientific and technological research, it is now possible to obtain large quantities of high-precision point clouds at a low cost and in a short period of time. Point clouds can include multiple points, each of which has geometric information and attribute information. Attribute information is composed of one or more types of attribute components. Practice has found that with the widespread application of point cloud technology, in some scenarios (such as digital cultural relics), the attribute information of each point includes multiple attribute components of the same type. How to describe multiple attribute components of the same type to facilitate the parsing and presentation of point cloud media has become a hot research issue. Summary of the Invention

[0003] Embodiments of the present invention provide a point cloud media data processing method, apparatus, device, and computer-readable storage medium, which can describe multiple attribute components of the same type.

[0004] In one aspect, an embodiment of the present application provides a method for processing point cloud media data, including:

[0005] Obtaining a media file of point cloud media, where the media file includes code stream data and attribute indication information of the point cloud media, where the code stream data includes at least two attribute components of the same type, and the attribute indication information is used to indicate a presentation method of the at least two attribute components of the same type;

[0006] Parse and present point cloud media based on attribute indication information and code stream data.

[0007] In an embodiment of the present application, a media file of point cloud media is obtained. The media file includes code stream data and attribute indication information of the point cloud media. The code stream data includes at least two attribute components of the same type. The attribute indication information is used to indicate the presentation method of the at least two attribute components of the same type. Based on the attribute indication information and the code stream data, the point cloud media is parsed and presented. It can be seen that the attribute indication information can be used to describe the at least two attribute components of the same type, so that the content consumption device can parse and present the point cloud media based on the attribute indication information.

[0008] In one aspect, an embodiment of the present application provides a method for processing point cloud media data, including:

[0009] Acquiring point cloud data of the point cloud media, and encoding the point cloud data to obtain code stream data of the point cloud media, wherein the code stream data of the point cloud media includes at least two attribute components of the same type;

[0010] Generate attribute indication information according to the code stream data, where the attribute indication information is used to indicate a presentation mode of at least two attribute components of the same type;

[0011] The code stream data and attribute indication information are encapsulated to obtain a media file of the point cloud media.

[0012] In an embodiment of the present application, point cloud data of point cloud media is acquired and encoded to obtain bitstream data of the point cloud media. The bitstream data of the point cloud media includes at least two attribute components of the same type. Attribute indication information is generated based on the bitstream data. The attribute indication information is used to indicate the presentation method of the at least two attribute components of the same type. The bitstream data and the attribute indication information are encapsulated to obtain a media file of the point cloud media. It can be seen that the attribute indication information is used to describe the at least two attribute components of the same type, so that the content consumption device can parse and present the point cloud media according to the attribute indication information.

[0013] In one aspect, an embodiment of the present application provides a point cloud media data processing device, the point cloud media data processing device comprising:

[0014] In one aspect, an embodiment of the present application provides a point cloud media data processing device, the point cloud media data processing device comprising:

[0015] an acquisition unit, configured to acquire a media file of the point cloud media, the media file comprising code stream data and attribute indication information of the point cloud media, the code stream data comprising at least two attribute components of the same type, and the attribute indication information being used to indicate a presentation mode of the at least two attribute components of the same type;

[0016] The processing unit is configured to parse and present the point cloud media according to the attribute indication information and the code stream data.

[0017] an acquisition unit, configured to acquire point cloud data of the point cloud media and encode the point cloud data to obtain code stream data of the point cloud media, wherein the code stream data of the point cloud media includes at least two attribute components of the same type;

[0018] a processing unit, configured to generate attribute indication information according to the code stream data, wherein the attribute indication information is used to indicate a presentation mode of at least two attribute components of the same type;

[0019] It is also used to encapsulate the code stream data and attribute indication information to obtain a media file of the point cloud media.

[0020] Accordingly, the present application provides a computer device, comprising:

[0021] a processor for loading and executing computer programs;

[0022] A memory stores a computer program, which, when executed by a processor, implements the above-mentioned point cloud media data processing method.

[0023] Accordingly, the present application provides a computer-readable storage medium storing a computer program, which is suitable for being loaded by a processor and executing the above-mentioned point cloud media data processing method.

[0024] Accordingly, the present application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the above-mentioned point cloud media data processing method.

[0025] In an embodiment of the present application, a content production device obtains point cloud data of point cloud media, encodes the point cloud data to obtain code stream data of the point cloud media, generates attribute indication information based on the code stream data, and encapsulates the code stream data and attribute indication information to obtain a media file of the point cloud media. A content consumption device obtains the media file of the point cloud media and parses and presents the point cloud media based on the attribute indication information and code stream data in the media file. This shows that the content production device uses attribute indication information to describe at least two attribute components of the same type, allowing the content consumption device to parse and present the point cloud media based on the attribute indication information. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0027] Figure 1a A schematic diagram of 6DoF provided in an embodiment of the present application;

[0028] Figure 1b A schematic diagram of a 3DoF provided in an embodiment of the present application;

[0029] Figure 1c A schematic diagram of 3DoF+ provided in an embodiment of the present application;

[0030] Figure 1d A diagram of a data processing architecture for point cloud media provided in an embodiment of the present application;

[0031] Figure 2 A flowchart of a method for processing point cloud media data provided in an embodiment of the present application;

[0032] Figure 3 A flowchart of another method for processing point cloud media data provided in an embodiment of the present application;

[0033] Figure 4 A schematic diagram of the structure of a point cloud media data processing device provided in an embodiment of the present application;

[0034] Figure 5 A schematic diagram of the structure of another point cloud media data processing device provided in an embodiment of the present application;

[0035] Figure 6 A schematic diagram of the structure of a content consumption device provided in an embodiment of the present application;

[0036] Figure 7 A schematic diagram of the structure of a content production device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0037] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0038] 1. Immersive Media

[0039] Immersive media refers to media files that provide immersive content, enabling viewers to experience real-world visual, auditory, and other sensory experiences. Immersive media can be categorized by the degree of freedom afforded to viewers when consuming content: 6DoF (Degree of Freedom) immersive media, 3DoF immersive media, and 3DoF+ immersive media.

[0040] 2. Point Cloud

[0041] A point cloud is a collection of randomly distributed, discrete points in space that represent the spatial structure and surface properties of a three-dimensional object or scene. Each point in a point cloud contains at least three-dimensional position information and, depending on the application scenario, may also contain color, material, or other information. Typically, each point in a point cloud has the same number of additional attributes.

[0042] 3. Point Cloud Media

[0043] Point cloud media is a typical 6DoF immersive media. It can flexibly and conveniently express the spatial structure and surface properties of three-dimensional objects or scenes. Therefore, it is widely used in projects such as virtual reality (VR) games, computer-aided design (CAD), geographic information systems (GIS), autonomous navigation systems (ANS), digital cultural heritage, free-viewpoint broadcasting, 3D immersive telepresence, and 3D reconstruction of biological tissues and organs.

[0044] 4. Track:

[0045] A track is a collection of media data within a media file. A media file can consist of one or more tracks. For example, a media file can contain a video track, an audio track, and a subtitle track. Metadata information can also be included as a media type within a file in the form of a metadata media track.

[0046] 5. Sample

[0047] A sample is a unit of media file encapsulation. A track consists of many samples. For example, a video track can consist of many samples, and a sample is usually a video frame. In this embodiment of the present application, a sample in a track can be a point cloud frame.

[0048] 6. Sample Number:

[0049] In one embodiment, the first sample in a track has a sequence number of 1.

[0050] 7. Sample Entry:

[0051] The sample entry is used to indicate metadata information related to all samples in the track. For example, the sample entry of a video track usually contains metadata information related to decoder initialization.

[0052] 8. Point Cloud Slice / Point Cloud Strip (Slice):

[0053] A point cloud slice / point cloud strip refers to a collection of syntax elements (such as geometric slices and attribute slices) of a point cloud frame in a partially or fully encoded point cloud media.

[0054] 9. Point cloud spatial block (Tile):

[0055] Point cloud spatial blocks are also called hexahedral spatial block areas within the boundary space of the point cloud frame. A point cloud spatial block consists of one or more point cloud slices, and there is no encoding and decoding dependency between point cloud spatial blocks.

[0056] 10. ISOBMFF (ISO Based Media File Format, a media file format based on ISO standards):

[0057] ISOBMFF is a packaging standard for media files, and a typical ISOBMFF file is an MP4 file.

[0058] 11. DASH (Dynamic Adaptive Streaming over HTTP):

[0059] DASH is an adaptive bitrate technology that enables high-quality streaming media to be delivered over the Internet using traditional HTTP web servers.

[0060] 12. MPD (Media Presentation Description, media presentation description signaling in DASH):

[0061] MPD is used to describe the media segment information in a media file.

[0062] 13. Representation level:

[0063] Representation refers to the combination of one or more media components in DASH. For example, a video file of a certain resolution can be regarded as a Representation. In this application, a video file of a certain time domain level can be regarded as a Representation.

[0064] 14. Adaptation Sets:

[0065] Adaptation Sets refers to a collection of one or more video streams in DASH. An Adaptation Set can contain multiple Representations.

[0066] The embodiments of the present application relate to data processing technology for point cloud media. Some concepts in the data processing process of point cloud media will be introduced below. It should be noted that the subsequent embodiments of the present application are described using immersive media as point cloud media as an example.

[0067] Figure 1a A schematic diagram of 6DoF provided for an embodiment of the present application; 6DoF is divided into window 6DoF, omnidirectional 6DoF and 6DoF, wherein window 6DoF means that the rotational movement of the immersive media viewer in the X-axis and Y-axis is limited, and the translation in the Z-axis is limited; for example, the immersive media viewer cannot see the scene outside the window frame, and the immersive media viewer cannot pass through the window. Omnidirectional 6DoF means that the rotational movement of the immersive media viewer in the X-axis, Y-axis and Z-axis is limited, for example, the immersive media viewer cannot freely pass through the three-dimensional 360-degree VR content in the restricted movement area. 6DoF means that the immersive media viewer can freely translate along the X-axis, Y-axis and Z-axis, for example, the immersive media viewer can freely walk around in the three-dimensional 360-degree VR content. Similar to 6DoF, there are 3DoF and 3DoF+ production technologies. Figure 1b A schematic diagram of a 3DoF provided in an embodiment of the present application; Figure 1b As shown, 3DoF means that the viewer of immersive media is fixed at the center point of a three-dimensional space, and the viewer's head rotates along the X-axis, Y-axis, and Z-axis to view the images provided by the media content. Figure 1c A schematic diagram of 3DoF+ provided in an embodiment of the present application is shown as follows: Figure 1c As shown, 3DoF+ means that when the virtual scene provided by the immersive media has certain depth information, the head of the immersive media viewer can move within a limited space based on 3DoF to view the images provided by the media content.

[0068] With the continuous development of science and technology, it is now possible to obtain large amounts of highly accurate point cloud data at a relatively low cost and in a relatively short period of time. Point cloud data can be obtained through computer generation, three-dimensional (3D) laser scanning, 3D photogrammetry, etc. Specifically, point cloud data can be obtained by collecting real-world visual scenes using acquisition equipment (a set of cameras or a camera device with multiple lenses and sensors). 3D laser scanning can obtain point clouds of static real-world three-dimensional objects or scenes, and can obtain millions of point cloud data per second. 3D photography can obtain point clouds of dynamic real-world three-dimensional objects or scenes, and can obtain tens of millions of point cloud data per second. In addition, in the medical field, point cloud data of biological tissues and organs can be obtained through magnetic resonance imaging (MRI), computed tomography (CT), and electromagnetic positioning information. For example, point cloud data can also be directly generated by a computer based on virtual three-dimensional objects and scenes, such as a computer can generate point cloud data of virtual three-dimensional objects and scenes. With the continuous accumulation of large-scale point cloud data, the efficient storage, transmission, publication, sharing and standardization of point cloud data have become the key to point cloud applications.

[0069] Figure 1d This is a data processing architecture diagram of a point cloud media provided in an embodiment of the present application. Figure 1d As shown in the figure, the data processing process at the content production device end mainly includes: (1) the process of acquiring the media content of the point cloud data; (2) the process of encoding and encapsulating the point cloud data. The data processing process at the content consumption device end mainly includes: (3) the process of decapsulating and decoding the point cloud data file; (4) the process of rendering the point cloud data. In addition, the transmission process of the point cloud media between the content production device and the content consumption device can be based on various transmission protocols. The transmission protocols here may include but are not limited to: DASH (Dynamic Adaptive Streaming over HTTP, dynamic adaptive streaming media transmission) protocol, HLS (HTTP Live Streaming, dynamic bit rate adaptive transmission) protocol, SMTP (Smart Media Transport Protocol, smart media transmission protocol), TCP (Transmission Control Protocol, transmission control protocol), etc.

[0070] The following is a detailed description of the data processing process of point cloud media:

[0071] (1) Obtain the media content of point cloud media.

[0072] The acquisition method for point cloud media content can be categorized into two methods: capturing real-world audio and visual scenes through a capture device and generating them through computer generation. In one implementation, the capture device can refer to a hardware component within the content production device, such as a microphone, camera, or sensor on a terminal. In another implementation, the capture device can be a hardware device connected to the content production device, such as a camera connected to a server, providing point cloud data media content acquisition services to the content production device. Capture devices may include, but are not limited to, audio equipment, video equipment, and sensor equipment. Audio equipment may include audio sensors and microphones. Video equipment may include standard cameras, stereo cameras, and light field cameras. Sensor equipment may include laser equipment and radar equipment. Multiple capture devices can be deployed at specific locations in real space to simultaneously capture audio and video content from different angles within that space, with the captured audio and video content synchronized in both time and space. Due to different acquisition methods, the compression encoding methods corresponding to the media content of different point cloud data may also vary.

[0073] (2) The process of encoding the media content of point cloud media and encapsulating the files.

[0074] Currently, the acquired point cloud data is usually encoded using the geometry-based point cloud compression (GPCC) encoding method to obtain a geometry-based point cloud compressed bitstream (including the encoded geometry bitstream and attribute bitstream). The encapsulation modes of the geometry-based point cloud compressed bitstream include single-track encapsulation mode and multi-track encapsulation mode.

[0075] Single-track encapsulation mode refers to encapsulating the point cloud code stream in the form of a single track. In single-track encapsulation mode, a sample will contain one or more coding content units (such as a geometry coding content unit and multiple attribute coding content units). The advantage of single-track encapsulation mode is that: based on the point cloud code stream, a single-track encapsulated point cloud file can be obtained without excessive processing.

[0076] Multi-track encapsulation mode encapsulates point cloud streams in the form of multiple tracks. In multi-track encapsulation mode, each track contains a component in the point cloud stream, namely a geometry component track and one or more attribute component tracks. The advantage of multi-track encapsulation is that different components are encapsulated separately, which helps the client select the required components for transmission and decoding consumption according to its own needs.

[0077] (3) The process of decapsulating and decoding point cloud media files;

[0078] The content consumption device can obtain the media file resources and corresponding media presentation description information of the point cloud data through the content production device. The media file resources and media presentation description information of the point cloud data are transmitted from the content production device to the content consumption device through a transmission mechanism (such as DASH, SMT). The file decapsulation process on the content consumption device side is the opposite of the file encapsulation process on the content production device side. The content consumption device decapsulates the media file resources according to the file format requirements of the point cloud media to obtain the encoded bit stream (GPCC bit stream or VPCC bit stream). The decoding process on the content consumption device side is the opposite of the encoding process on the content production device side. The content consumption device decodes the encoded bit stream to restore the point cloud data.

[0079] (4) Rendering process of point cloud media.

[0080] The content consumption device renders the point cloud data obtained by decoding the GPCC bit stream according to the metadata related to rendering and window in the media presentation description information, obtains the point cloud frame of the point cloud media, and presents the point cloud media according to the presentation time of the point cloud frame.

[0081] In one embodiment, a content production device first samples a real-world visual scene through an acquisition device to obtain point cloud data corresponding to the real-world visual scene; then encodes the acquired point cloud data through geometry-based point cloud compression (GPCC) to obtain a GPCC bitstream (including an encoded geometry bitstream and an attribute bitstream); then encapsulates the GPCC bitstream to obtain a media file corresponding to the point cloud data (i.e., point cloud media). Specifically, the content production device synthesizes one or more encoded bitstreams into a media file for file playback or a sequence of initialization segments and media segments for streaming according to a specific media container file format; wherein the media container file format refers to the ISO base media file format specified in the International Organization for Standardization (ISO) / International Electrotechnical Commission (IEC) 14496-12. In one embodiment, the content production device also encapsulates metadata into the media file or the sequence of initialization / media segments, and transmits the sequence of initialization / media segments to the content consumption device via a transmission mechanism (such as a dynamic adaptive streaming media transmission interface).

[0082] On the content consumption device side: First, the point cloud media file sent by the content production device is received, including: a media file for file playback, or a sequence of initialization segments and media segments for streaming; then the point cloud media file is decapsulated to obtain an encoded GPCC bitstream; then the encoded GPCC bitstream is parsed (i.e., the encoded GPCC bitstream is decoded to obtain point cloud data); in a specific implementation, the content consumption device determines the media file or media segment sequence required to present the point cloud media based on the current object's viewing position / viewing direction; and decodes the media file or media segment sequence required to present the point cloud media to obtain the point cloud data required for presentation. Finally, based on the current object's viewing (viewing window) direction, the decoded point cloud data is rendered to obtain the point cloud media point cloud frame, and the point cloud media is presented on the screen of the head-mounted display or any other display device carried by the content consumption device according to the presentation time of the point cloud frame. It should be noted that the current object's viewing position / viewing direction is determined by head tracking and possibly visual tracking functions. In addition to using a renderer to render point cloud data of the current object's viewing position / viewing direction, an audio decoder may also be used to optimize decoding of audio in the current object's viewing (viewing window) direction.

[0083] Among them, content production equipment and content consumption equipment can together constitute a point cloud media system. Content production equipment can refer to the computer equipment used by the provider of point cloud media (such as the content producer of point cloud media), and the computer equipment can be a terminal (such as PC (Personal Computer, personal computer), smart mobile device (such as smart phone), etc.) or a server; wherein the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Content consumption equipment can refer to the computer equipment used by the user of point cloud media (such as the viewer of point cloud media), and the computer equipment can be a terminal (such as PC (Personal Computer, personal computer), smart mobile device (such as smart phone), VR device (such as VR helmet, VR glasses, etc.), smart home appliances, vehicle-mounted terminals, aircraft, etc.).

[0084] It is understood that the data processing technology for point cloud media involved in this application can be implemented using cloud technology; for example, using a cloud server as a content production device. Cloud technology refers to a hosting technology that unifies hardware, software, network and other resources within a wide area network or local area network to achieve data computing, storage, processing and sharing.

[0085] Based on the above introduction to point cloud media, this application proposes a data processing method for point cloud media, which can be applied to scenes containing multiple attribute components of the same type (such as digital cultural relics point cloud scenes). At least two attribute components of the same type are described through attribute indication information, so that content consumption devices can parse and present point cloud media according to the attribute indication information.

[0086] In one embodiment, the attribute indication information includes a multi-attribute instance information data box (GPCCMultiAttrInsInfoBox), which is used to indicate descriptive information of multiple attribute components of the same attribute type. The multi-attribute instance information data box can be included in a sample entry (SampleEntry). The type of the multi-attribute instance information data box is: 'gmai'; the mandatory type is: no; and the quantity is 0 or 1. The syntax of the multi-attribute instance information data box can be seen in Table 1 below:

[0087] Table 1

[0088]

[0089] The semantics of the syntax in Table 1 above are as follows:

[0090] The attribute quantity field (attr_num) is used to indicate the number of attribute components with multi-attribute instance information (i.e., attribute components of the same type) in the current track. In one embodiment, attribute components of the same type are encapsulated in one or more tracks, each of which encapsulates a multi-attribute instance information data box. The attribute quantity field in the multi-attribute instance information data box in the target track is used to indicate the number of attribute components with multi-attribute instance information (i.e., attribute components of the same type) in the target track. The target track can be any of the one or more aforementioned tracks.

[0091] The attribute index field (attr_index) is used to indicate the index number of the corresponding attribute component. In one embodiment, each attribute index field corresponds to an attribute component, and the attribute index field corresponding to the target attribute component is used to indicate the index number of the target attribute component. The target attribute component can be any one of multiple attribute components of the same type.

[0092] When the default attribute flag field (default_attr_flag) takes the first setting value (such as 1), it indicates that the current attribute component is the attribute component presented by default among multiple attribute components of the same type; when the field takes the second setting value (such as 0), it indicates that the current attribute component is not the attribute component presented by default among multiple attribute components of the same type. In one embodiment, each default attribute flag field corresponds to an attribute component. When the value of the default attribute flag field corresponding to the target attribute component is the first setting value, it indicates that the target attribute component is the attribute component presented by default among multiple attribute components of the same type; when the value of the default attribute flag field corresponding to the target attribute component is the second setting value, it indicates that the target attribute component is not the attribute component presented by default among multiple attribute components of the same type, and the target attribute component can be any one of the multiple attribute components of the same type.

[0093] The attribute label field (attr_label) indicates the descriptive information of the current attribute component; for example, the value of the attribute label field can indicate the type of the attribute of the current attribute component. In one embodiment, each attribute label field corresponds to an attribute component, and the attribute label field corresponding to the target attribute component is used to indicate the descriptive information of the target attribute component. The target attribute component can be any one of multiple attribute components of the same type. In addition, the attribute label field can be used to describe the difference information between multiple attribute components of the same type, that is, the difference between each attribute component can be described through the attribute label field corresponding to each attribute component.

[0094] Optionally, if multiple attribute types in the code stream data each have multiple attribute instances, that is, the code stream data contains at least multiple (at least two) attribute components belonging to the first type and multiple (at least two) attribute components belonging to the second type; then when presenting these attribute instances, attribute components with the same value of the attribute label field (attr_label) can be presented simultaneously.

[0095] In another embodiment, the attribute indication information includes a component information data box (GPCCComponentInfoBox), which includes description information of each component in the code stream data (such as description information of multiple attribute components of the same type). The syntax of the multi-attribute instance information data box can be seen in Table 2 below:

[0096] Table 2

[0097]

[0098]

[0099] The semantics of the syntax in Table 2 above are as follows:

[0100] The G-PCC type field (gpcc_type) is used to indicate the type of the G-PCC component. When the value of this field is 2, it indicates that the current component is a geometric component; when the value of this field is 4, it indicates that the current component is an attribute component; other values ​​are reserved.

[0101] The attribute index field (attr_index) is used to indicate the sequence number of the attribute component corresponding to the field in the sequence parameter set.

[0102] The attribute type flag field (attr_type_present_flag) is used to indicate whether the current data box (such as the component information data box) contains the attribute type field. When the value of this field is 1, it means that the current data box contains the attribute type indication field; when the value of this field is 0, it means that the current data box does not contain the attribute type indication field.

[0103] The attribute type field (attr_type) is used to indicate the type of the attribute component. The value of this field follows the definition of the corresponding G-PCC coding standard.

[0104] The attribute name field (attr_name) is used to indicate the type of the readable attribute component.

[0105] The attribute information flag field (attr_info_present_flag) is used to indicate whether the current data box (e.g., the component information data box) contains description information of the attribute component. When the value of this field is a first setting value (e.g., 1), it indicates that the current data box contains description information of the attribute component; when the value of this field is a second setting value (e.g., 0), it indicates that the current data box does not contain description information of the attribute component.

[0106] When the default attribute flag field (default_attr_flag) takes the first setting value (such as 1), it indicates that the current attribute component is the default attribute component among multiple attribute components of the same type; when the field takes the second setting value (such as 0), it indicates that the current attribute component is not the default attribute component among multiple attribute components of the same type. In one embodiment, each default attribute flag field corresponds to an attribute component. When the value of the default attribute flag field corresponding to the target attribute component is the first setting value, it indicates that the target attribute component is the default attribute component among multiple attribute components of the same type; when the value of the default attribute flag field corresponding to the target attribute component is the second setting value, it indicates that the target attribute component is not the default attribute component among multiple attribute components of the same type, and the target attribute component can be any one of the multiple attribute components of the same type.

[0107] The attribute label field (attr_label) indicates the descriptive information of the current attribute component; for example, the value of the attribute label field can indicate the type of the attribute of the current attribute component. In one embodiment, each attribute label field corresponds to an attribute component, and the attribute label field corresponding to the target attribute component is used to indicate the descriptive information of the target attribute component. The target attribute component can be any one of multiple attribute components of the same type. In addition, the attribute label field can be used to describe the difference information between multiple attribute components of the same type, that is, the difference between each attribute component can be described through the attribute label field corresponding to each attribute component.

[0108] Optionally, if multiple attribute types in the code stream data each have multiple attribute instances, that is, the code stream data contains at least multiple (at least two) attribute components belonging to the first type and multiple (at least two) attribute components belonging to the second type; then when presenting these attribute instances, attribute components with the same value of the attribute label field (attr_label) can be presented simultaneously.

[0109] In another embodiment, if there are multiple attribute components for more than one type of attribute in the bitstream data, that is, the bitstream data contains at least multiple (at least two) attribute components of the first type and multiple (at least two) attribute components of the second type; then the attribute indication information includes track group indication information (AttrInsCombinationGroup), and the track group indication information is used to indicate that the attribute components can be presented simultaneously. In one embodiment, the track group indication information indicates that the attribute components can be presented simultaneously by indicating the track group associated with the track that encapsulates the attribute component. The syntax of the track group indication information can be seen in Table 3 below:

[0110] Table 3

[0111]

[0112] The semantics of the syntax in Table 3 above are as follows:

[0113] The track group identification field (track_group_id) is used to indicate the identifier of a track group. Multiple tracks with the same track group type and track group identifier belong to the same track group. In one embodiment, the track group indication information further includes a track group type field, which indicates the type of track group to which the track corresponding to the track group identification field belongs. The value of the track group identification field of the first track indicates the identifier of the track group to which the first track belongs. If the value of the track group identification field of the first track is the same as the value of the track group identification field of the second track, and the track group type to which the first track belongs is the same as the track group type to which the second track belongs (for example, the value of the track group type field of the first track is the same as the value of the track group type field of the second track), then the first track and the second track belong to the same track group.

[0114] The descriptive information corresponding to the multi-attribute instance information data box (GPCCMultiAttrInsInfoBox) is stored in the multi-attribute instance information descriptor (GPCCMultiAttrInsInfo descriptor) provided in the embodiments of this application. The multi-attribute instance information descriptor is used to indicate the descriptive information of multiple different attribute instances of the same attribute type (i.e., multiple attribute components belonging to the same attribute type). The multi-attribute instance information descriptor is a supplemental property (SupplementalProperty) element, whose @schemeIdUri attribute is "urn:avs:ims:2022:apcc". The multi-attribute instance information descriptor is included in the transmission signaling file. Specifically, the transmission signaling file includes a representation level and an adaptation set level. An adaptation set level can contain one or more representation levels. The multi-attribute instance information descriptor can exist at the representation level or the adaptation set level. When the multi-attribute instance information descriptor exists at the target adaptation set level, it is used to describe all representation levels in the target adaptation set level. When the multi-attribute instance information descriptor exists at the target representation level, it is used to describe the target representation level. The attributes of the transmission signaling file are shown in Table 4 below:

[0115] Table 4

[0116]

[0117] Among them, O represents the corresponding attribute is Optional; CM represents the corresponding attribute is Conditional Mandatory; M represents the corresponding attribute is Mandatory.

[0118] In the embodiment of the present application, at least two attribute components of the same type are described by attribute indication information, so that the content consumption device can parse and present the point cloud media according to the attribute indication information.

[0119] Figure 2 This is a flow chart of a method for processing point cloud media data provided in an embodiment of the present application; the method can be executed by a content consumption device in a point cloud media system, and the method includes the following steps S201 and S202:

[0120] S201: Obtain media files of point cloud media.

[0121] The media file contains the bitstream data and attribute indication information of the point cloud media. The bitstream data contains at least two attribute components of the same type; for example, the bitstream data contains attribute component 1 and attribute component 2, and attribute component 1 and attribute component 2 are both color-type attribute components. The attribute indication information is used to indicate the presentation method of at least two attribute components of the same type. Specifically, the attribute indication information describes the attribute components in the bitstream data (such as the number of attribute components of the same type contained in the bitstream data, the index number of each attribute component, etc.), and indicates how the attribute components are presented (such as whether the current attribute component is the default attribute component, and the attribute components that can be presented simultaneously with the current attribute component, etc.).

[0122] In one embodiment, the content consumption device downloads the complete file of the point cloud media. The media file of the point cloud media is obtained from the complete file of the point cloud media stored locally by the content consumption device according to the requirements of the object (such as the presentation frame rate of the point cloud media set by the object) or its own decoding capabilities.

[0123] In another embodiment, a point cloud media file is sliced ​​into multiple media segments. A content consumption device obtains a transmission signaling file for the point cloud media. The transmission signaling file contains descriptive information for attribute indication information. The descriptive information for attribute indication information includes a multi-attribute instance information descriptor (GPCCMultiAttrInsInfo descriptor). The multi-attribute instance information descriptor is a SupplementalProperty element. See Table 4 above for details and are not further described here. Based on the descriptive information for attribute indication information in the transmission signaling file, as well as the requirements of the subject (e.g., the viewer) (e.g., the point cloud media presentation frame rate set by the subject), the viewer's virtual perspective, the content consumption device's decoding capabilities, or current network conditions (e.g., the network transmission speed), the content consumption device determines the media segments required to present the point cloud media (e.g., the attribute components required to present the point cloud media), and then pulls the determined media file for the point cloud media via streaming. For example, assuming that the complete point cloud media file contains two attribute components 1 and 2 of the same type, and only attribute component 1 is required for the current point cloud media presentation, the content consumption device only needs to pull attribute component 1 via streaming.

[0124] S202: Parse and present the point cloud media according to the attribute indication information and the code stream data.

[0125] In one embodiment, the attribute indication information includes a multi-attribute instance information data box, where the multi-attribute instance information data box is used to indicate description information of at least two attribute components of the same type.

[0126] In one embodiment, at least two attribute components of the same type are encapsulated in one or more tracks, and at least two attribute components of the same type have multi-attribute instance information, and the multi-attribute instance information data box contains an attribute quantity field (attr_num); the content consumption device parses the point cloud media according to the attribute indication information and the bitstream data, including determining, according to the attribute quantity field, the number of attribute components with multi-attribute instance information in the track corresponding to the attribute quantity field; for example, assuming that the value of the attribute quantity field contained in the multi-attribute instance information data box in track 1 is 3, the content consumption device determines that the number of attribute components with multi-attribute instance information in track 1 is 3 (i.e., 3 attribute components of the same type are encapsulated in track 1).

[0127] It should be noted that if a type of attribute contains only one attribute component, then the attribute component has single attribute instance information; if a type of attribute contains only multiple (at least two) attribute components, then each attribute component has multiple attribute instance information.

[0128] In one embodiment, the multi-attribute instance information data box includes an attribute index field (attr_index); the process of parsing the point cloud media by the content consumption device based on the attribute indication information and the code stream data includes determining the index number of the attribute component corresponding to the attribute index field based on the attribute index field; for example, assuming that the value of the attribute index field corresponding to attribute component 1 is x, the content consumption device determines that the index number of attribute component 1 is x based on the attribute index field.

[0129] In one embodiment, the multi-attribute instance information data box includes a default attribute flag field (default_attr_flag); the process of the content consumption device parsing the point cloud media according to the attribute indication information and the code stream data includes: if the value of the default attribute flag field is a first set value (such as 1), then determining that the attribute component corresponding to the default attribute flag field is the attribute component presented by default in at least two attribute components belonging to the same type; if the value of the default attribute flag field is a second set value (such as 0), then determining that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default in at least two attribute components belonging to the same type.

[0130] For example, assuming that attribute component 1 and attribute component 2 are of the same type, and the value of the default attribute flag field corresponding to attribute component 1 is 1, and the value of the default attribute flag field corresponding to attribute component 2 is 0; then the content consumption device determines that attribute component 1 is the default attribute component presented in attribute component 1 and attribute component 2 based on the value of the default attribute flag field corresponding to attribute component 1, and accordingly, the content consumption device determines that attribute component 2 is not the default attribute component presented in attribute component 1 and attribute component 2 based on the value of the default attribute flag field corresponding to attribute component 2.

[0131] In one embodiment, the multi-attribute instance information data box includes an attribute label field (attr_label); the content consumption device parses the point cloud media based on the attribute indication information and the bitstream data, including determining, based on the attribute label field, the description information of the attribute component corresponding to the attribute label field. It should be noted that the attribute label field corresponding to each attribute component of the same type may describe the differences between the attribute component and other attribute components of the same type.

[0132] Taking the digital cultural relic restoration scenario as an example, assuming that attribute component 1 and attribute component 2 belong to the color type, and the value of the attribute tag field corresponding to attribute component 1 is "original", and the value of the attribute tag field corresponding to attribute component 2 is "repaired"; then the content consumption device determines that attribute component 1 is used to indicate the color of the digital cultural relic before restoration based on the value of the attribute tag field corresponding to attribute component 1, and the content consumption device determines that attribute component 2 is used to indicate the color of the digital cultural relic after restoration based on the value of the attribute tag field corresponding to attribute component 2.

[0133] Optionally, if multiple attribute types in the code stream data all have multiple attribute instances (such as one attribute instance corresponds to one attribute component), that is, the code stream data contains at least multiple (at least two) attribute components belonging to the first type and multiple (at least two) attribute components belonging to the second type; then when presenting these attribute instances, attribute components with the same value of the attribute label field (attr_label) can be presented simultaneously; for example, assuming that the code stream data contains attribute component 1 and attribute component 2 belonging to the color type, and attribute component 3 and attribute component 4 belonging to the reflectivity type, and the attribute label field values ​​of attribute component 1 and attribute component 3 are the same, and the attribute label field values ​​of attribute component 2 and attribute component 4 are the same; then attribute component 1 and attribute component 3 can be presented simultaneously, and attribute component 2 and attribute component 4 can be presented simultaneously.

[0134] In another embodiment, the attribute indication information includes a component information data box (GPCCComponentInfoBox), which includes description information of each component in the code stream data. It should be noted that the component information data box in this application is obtained by expanding the existing component information data box. The expanded component information data box includes description information of multiple (at least two) attribute components of the same type.

[0135] In one embodiment, the component information data box includes an attribute information flag field (attr_info_present_flag); the process of the content consumption device parsing the point cloud media according to the attribute indication information and the code stream data includes: if the value of the attribute information flag field is a first set value (such as 1), then it is determined that the data box corresponding to the attribute information flag field (i.e., the component information data box) contains the description information of the attribute component; if the value of the attribute information flag field is a second set value (such as 0), then it is determined that the data box corresponding to the attribute information flag field (i.e., the component information data box) does not contain the description information of the attribute component.

[0136] In one embodiment, the component information data box includes a default attribute flag field (default_attr_flag); the process of parsing the point cloud media by the content consumption device according to the attribute indication information and the code stream data includes: if the value of the default attribute flag field is a first set value (such as 1), then determining that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type; if the value of the default attribute flag field is a second set value (such as 0), then determining that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0137] For example, assuming that attribute component 1 and attribute component 2 are of the same type, and the value of the default attribute flag field corresponding to attribute component 1 is 1, and the value of the default attribute flag field corresponding to attribute component 2 is 0; then the content consumption device determines that attribute component 1 is the default attribute component presented in attribute component 1 and attribute component 2 based on the value of the default attribute flag field corresponding to attribute component 1, and accordingly, the content consumption device determines that attribute component 2 is not the default attribute component presented in attribute component 1 and attribute component 2 based on the value of the default attribute flag field corresponding to attribute component 2.

[0138] In one embodiment, the component information data box includes an attribute label field (attr_label); the content consumption device parses the point cloud media based on the attribute indication information and the bitstream data, including determining, based on the attribute label field, the description information of the attribute component corresponding to the attribute label field. It should be noted that the attribute label field corresponding to each attribute component of the same type may describe the differences between the attribute component and other attribute components of the same type.

[0139] Taking the digital cultural relic restoration scenario as an example, assuming that attribute component 1 and attribute component 2 belong to the color type, and the value of the attribute tag field corresponding to attribute component 1 is "original", and the value of the attribute tag field corresponding to attribute component 2 is "repaired"; then the content consumption device determines that attribute component 1 is used to indicate the color of the digital cultural relic before restoration based on the value of the attribute tag field corresponding to attribute component 1, and the content consumption device determines that attribute component 2 is used to indicate the color of the digital cultural relic after restoration based on the value of the attribute tag field corresponding to attribute component 2.

[0140] Optionally, if multiple attribute types in the code stream data all have multiple attribute instances (such as one attribute instance corresponds to one attribute component), that is, the code stream data contains at least multiple (at least two) attribute components belonging to the first type and multiple (at least two) attribute components belonging to the second type; then when presenting these attribute instances, attribute components with the same value of the attribute label field (attr_label) can be presented simultaneously; for example, assuming that the code stream data contains attribute component 1 and attribute component 2 belonging to the color type, and attribute component 3 and attribute component 4 belonging to the reflectivity type, and the attribute label field values ​​of attribute component 1 and attribute component 3 are the same, and the attribute label field values ​​of attribute component 2 and attribute component 4 are the same; then attribute component 1 and attribute component 3 can be presented simultaneously, and attribute component 2 and attribute component 4 can be presented simultaneously.

[0141] In another embodiment, there are multiple attribute components for more than one type of attribute in the code stream data, that is, the code stream data contains at least multiple (at least two) attribute components belonging to the first type and multiple (at least two) attribute components belonging to the second type, and each attribute component is encapsulated in a track; specifically, in the multi-track encapsulation mode, different attribute components can be encapsulated in different tracks; in the single-track encapsulation mode, different attribute components can be encapsulated in the same track. The attribute indication information includes track group indication information (AttrInsCombinationGroup), and the track group indication information is used to indicate the attribute components that can be presented simultaneously. In one implementation, the content consumption device can determine whether the two attribute components can be presented simultaneously by the track group corresponding to the track to which the two attribute components belong; for example, if the tracks to which the two attribute components belong correspond to the same track group, it means that the two attribute components can be presented simultaneously.

[0142] In one embodiment, the track group indication information includes a track group identification field (track_group_id); the content consumption device parses the point cloud media according to the attribute indication information and the code stream data, including determining, based on the track group identification field, the track group to which the track corresponding to the track group identification field belongs; for example, assuming that the value of the track group identification field corresponding to track 1 is 2, the content consumption device determines that track 1 belongs to track group 2 based on the value of the track group identification field corresponding to track 1.

[0143] Furthermore, the track group indication information also includes a track group type field, which is used to indicate the type of track group to which the track corresponding to the track group type field belongs. If at least two tracks in the bitstream data have the same track group identification field value and the same track group type field value, the content consumption device determines that these at least two tracks belong to the same track group. For example, assuming that the track group identification field value corresponding to track 1 is 2 and the track group type field value is x; the track group identification field value corresponding to track 2 is 1 and the track group type field value is y; and the track group identification field value corresponding to track 3 is 2 and the track group type field value is x, the content consumption device determines that tracks 1 and 3 belong to the same track group.

[0144] Furthermore, the process of presenting the point cloud media by the content consumption device according to the attribute indication information and the code stream data includes simultaneously presenting the attribute components belonging to the same track group.

[0145] In an embodiment of the present application, a media file of point cloud media is obtained. The media file includes code stream data and attribute indication information of the point cloud media. The code stream data includes at least two attribute components of the same type. The attribute indication information is used to indicate the presentation method of the at least two attribute components of the same type. Based on the attribute indication information and the code stream data, the point cloud media is parsed and presented. It can be seen that the attribute indication information can be used to describe the at least two attribute components of the same type, so that the content consumption device can parse and present the point cloud media based on the attribute indication information.

[0146] Figure 3 This is a flowchart of another method for processing point cloud media data provided by an embodiment of the present application; the method can be performed by a content production device in a point cloud media system, and the method includes the following steps S301 and S303:

[0147] S301: Acquire point cloud data of point cloud media, and encode the point cloud data to obtain code stream data of the point cloud media.

[0148] The code stream data of point cloud media contains at least two attribute components of the same type. The specific method of obtaining point cloud data of point cloud media can be referred to Figure 1d In the implementation method of (1), the content production device encodes the point cloud data to obtain the specific implementation method of the point cloud media code stream data can be referred to Figure 1d The implementation method of (2) will not be described in detail here.

[0149] S302: Generate attribute indication information according to the code stream data.

[0150] The attribute indication information is used to indicate the presentation mode of at least two attribute components of the same type contained in the code stream data.

[0151] In one embodiment, the attribute indication information includes a multi-attribute instance information data box (GPCCMultiAttrInsInfoBox), and the multi-attribute instance information data box is used to indicate description information of at least two attribute components of the same type.

[0152] In one embodiment, at least two attribute components of the same type are encapsulated in one or more tracks, and at least two attribute components of the same type have multiple attribute instance information. The multiple attribute instance information data box includes an attribute quantity field (attr_num) that indicates the number of attribute components with multiple attribute instance information in the track corresponding to the attribute quantity field. The process of generating attribute indication information based on bitstream data by a content production device includes determining a value of the attribute quantity field corresponding to the track based on the number of attribute components with multiple attribute instance information in the track.

[0153] It should be noted that if a type of attribute contains only one attribute component, then the attribute component has single attribute instance information; if a type of attribute contains only multiple (at least two) attribute components, then each attribute component has multiple attribute instance information.

[0154] In one embodiment, the multi-attribute instance information data box includes an attribute index field (attr_index), which indicates the index number of the attribute component corresponding to the attribute index field. The process of generating attribute indication information based on the bitstream data by the content production device includes: assigning different index numbers to different attribute components; and setting the index number of the target attribute component to the value of the attribute index field corresponding to the target attribute component; wherein the target attribute component can be any attribute component in the bitstream data.

[0155] In one embodiment, the multi-attribute instance information data box includes a default attribute flag field (default_attr_flag); when the default attribute flag field takes a first set value (such as 1), it is used to indicate that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type; when the default attribute flag field takes a second set value (such as 0), it is used to indicate that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0156] The process of a content production device generating attribute indication information based on code stream data includes: if the target attribute component is the attribute component presented by default among at least two attribute components of the same type, the content production device sets the default attribute flag field corresponding to the target attribute component to a first set value (such as 1); if the target attribute component is not the attribute component presented by default among at least two attribute components of the same type, the content production device sets the default attribute flag field corresponding to the target attribute component to a second set value (such as 0); wherein the target attribute component can be any one of the at least two attribute components of the same type.

[0157] In one embodiment, the multi-attribute instance information data box includes an attribute label field (attr_label), which is used to describe the attribute component corresponding to the attribute label field. The process of generating attribute indication information based on the bitstream data by the content production device includes configuring the value of the attribute label field corresponding to the target attribute component based on the description information of the target attribute component. It should be noted that the attribute label field corresponding to each attribute component of the same type can describe the differences between the attribute component and other attribute components of the same type.

[0158] Optionally, if multiple attribute types in the bitstream data each have multiple attribute instances (e.g., one attribute instance corresponds to one attribute component), that is, the bitstream data contains at least multiple (at least two) attribute components of a first type and multiple (at least two) attribute components of a second type; then the content production device may use the attribute tag field to indicate the attribute components that can be presented simultaneously. The process of the content production device generating attribute indication information based on the bitstream data includes: configuring the values ​​of the attribute tag fields corresponding to the attribute components that can be presented simultaneously to be the same.

[0159] In another embodiment, the attribute indication information includes a component information data box (GPCCComponentInfoBox), which includes description information of each component in the code stream data. It should be noted that the component information data box in this application is obtained by expanding the existing component information data box. The expanded component information data box includes description information of multiple (at least two) attribute components of the same type.

[0160] In one embodiment, the component information data box includes an attribute information flag field (attr_info_present_flag); the attribute information flag field is used to indicate whether the component information data box contains description information of the attribute component; when the attribute information flag field takes a first set value (such as 1), it is used to indicate that the component information data box contains description information of the attribute component; when the attribute information flag field takes a second set value (such as 0), it is used to indicate that the component information data box does not contain description information of the attribute component.

[0161] The process of a content production device generating attribute indication information based on code stream data includes: if the component information data box contains description information of the attribute component, then the attribute information flag field in the component information data box is configured to a first set value (such as 1); if the component information data box does not contain description information of the attribute component, then the attribute information flag field in the component information data box is configured to a second set value (such as 0).

[0162] In one embodiment, the component information data box includes a default attribute flag field (default_attr_flag); when the default attribute flag field takes a first set value (such as 1), it is used to indicate that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type; when the default attribute flag field takes a second set value (such as 0), it is used to indicate that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0163] The process of a content production device generating attribute indication information based on code stream data includes: if the target attribute component is the attribute component presented by default among at least two attribute components of the same type, the content production device sets the default attribute flag field corresponding to the target attribute component to a first set value (such as 1); if the target attribute component is not the attribute component presented by default among at least two attribute components of the same type, the content production device sets the default attribute flag field corresponding to the target attribute component to a second set value (such as 0); wherein the target attribute component can be any one of the at least two attribute components of the same type.

[0164] In one embodiment, the component information data box includes an attribute label field (attr_label), which is used to describe the attribute component corresponding to the attribute label field. The process of generating attribute indication information based on the bitstream data by the content production device includes configuring the value of the attribute label field corresponding to the target attribute component based on the description information of the target attribute component. It should be noted that the attribute label field corresponding to each attribute component of the same type can describe the differences between the attribute component and other attribute components of the same type.

[0165] Optionally, if multiple attribute types in the bitstream data each have multiple attribute instances (e.g., one attribute instance corresponds to one attribute component), that is, the bitstream data contains at least multiple (at least two) attribute components of a first type and multiple (at least two) attribute components of a second type; then the content production device may use the attribute tag field to indicate the attribute components that can be presented simultaneously. The process of the content production device generating attribute indication information based on the bitstream data includes: configuring the values ​​of the attribute tag fields corresponding to the attribute components that can be presented simultaneously to be the same.

[0166] In another embodiment, there are multiple attribute components for more than one type of attribute in the codestream data, that is, the codestream data includes at least multiple (at least two) attribute components belonging to the first type and multiple (at least two) attribute components belonging to the second type; each attribute component is encapsulated in a track, and the attribute indication information includes track group indication information (AttrInsCombinationGroup), and the track group indication information is used to indicate the attribute components presented simultaneously.

[0167] In one embodiment, the track group indication information includes a track group identification field (track_group_id), which indicates the track group to which the track corresponding to the track group identification field belongs. The process of generating attribute indication information based on the bitstream data by the content production device includes configuring the value of the track group identification field corresponding to the target track based on the identifier of the track group to which the target track belongs; the target track can be any track in the bitstream data.

[0168] Furthermore, the track group indication information further includes a track group type field, which is used to indicate the type of track group to which the track corresponding to the track group type field belongs. If the track group identification field of at least two tracks has the same value, and the track group type field of at least two tracks has the same value, then at least two tracks belong to the same track group. The process of the content production device generating attribute indication information based on the bitstream data includes: if the first track and the second track belong to the same track group, the content production device configures the track group identification field corresponding to the first track and the second track to the same value, and also configures the track group type field corresponding to the first track and the second track to the same value.

[0169] In one implementation, the content production device can indicate whether the two attribute components can be presented simultaneously by indicating the track group corresponding to the track to which the two attribute components belong; for example, if the two attribute components can be presented simultaneously, the track group indication information indicates that the tracks to which the two attribute components belong belong to the same track group.

[0170] S303: Encapsulate the code stream data and the attribute indication information to obtain a media file of the point cloud media.

[0171] The content production device encapsulates the code stream data and attribute indication information to obtain the specific implementation method of the point cloud media file. Figure 1d The implementation method of (2) will not be described in detail here.

[0172] In one embodiment, the content production device may further generate a transmission signaling file for the point cloud media, the transmission signaling file including descriptive information of attribute indication information. The descriptive information of the attribute indication information includes a multi-attribute instance information descriptor (GPCCMultiAttrInsInfo descriptor), which is a supplemental property (SupplementalProperty) element. See Table 4 above for details and will not be repeated here.

[0173] Specifically, the transmission signaling file includes a representation layer and an adaptation set layer, and the adaptation set layer includes one or more representation layers; when the description information exists in the target adaptation set layer, it is used to describe all representation layers in the target adaptation set layer; when the description information exists in the target representation layer, it is used to describe the target representation layer.

[0174] The content production device can encapsulate the code stream data and attribute indication information in a multi-track encapsulation mode or a single-track encapsulation mode. The following uses the multi-track encapsulation mode and the single-track encapsulation mode as examples to explain in detail the data processing method of point cloud media provided by this application.

[0175] In one embodiment, a content production device obtains point cloud data of a point cloud media, encodes the point cloud data to obtain code stream data of the point cloud media, generates attribute indication information based on the code stream data, and uses a multi-track encapsulation mode to encapsulate the code stream data and the attribute indication information to obtain a media file of the point cloud media.

[0176] Assume that the bitstream data of the point cloud media contains one geometry component data, two color attribute component data, and two reflectivity attribute component data, and all component data of the point cloud media are encapsulated in a multi-track encapsulation mode, that is, one component data is contained in one track. Then:

[0177] Track 0: A track used to encapsulate geometric components.

[0178] Track 1: This is the track that encapsulates the first color attribute component. The attribute information corresponding to Track 1 is as follows:

[0179]

[0180] Among them, "attr_num=1" indicates that the number of attribute components with multi-attribute instance information contained in track 1 is 1; "attr_index=1" indicates that the index number of the attribute component corresponding to the field is 1; "default_attr_flag=1" indicates that the attribute component corresponding to the field is the default attribute component presented in the attribute component of the color type; "attr_label="original"" indicates that the attribute label of the attribute component corresponding to the field is "original".

[0181] Track 2: This is the track that encapsulates the second color attribute component. The attribute information corresponding to Track 2 is as follows:

[0182]

[0183] Among them, "attr_num=1" indicates that the number of attribute components with multi-attribute instance information contained in track 2 is 1; "attr_index=2" indicates that the index number of the attribute component corresponding to this field is 2; "default_attr_flag=0" indicates that the attribute component corresponding to this field is not the default attribute component presented in the attribute component of the color type; "attr_label="repaired"" indicates that the attribute label of the attribute component corresponding to this field is "repaired".

[0184] Track 3: This is the track that encapsulates the first reflectivity attribute component. The attribute information corresponding to Track 3 is as follows:

[0185]

[0186] Among them, "attr_num=1" indicates that the number of attribute components with multi-attribute instance information contained in track 3 is 1; "attr_index=3" indicates that the index number of the attribute component corresponding to this field is 3; "default_attr_flag=1" indicates that the attribute component corresponding to this field is the default attribute component presented in the attribute component of the reflectivity type; "attr_label="original"" indicates that the attribute label of the attribute component corresponding to this field is "original".

[0187] Track 4: This is the track that encapsulates the second reflectivity attribute component. The attribute information corresponding to Track 4 is as follows:

[0188]

[0189] Among them, "attr_num=1" indicates that the number of attribute components with multi-attribute instance information contained in track 4 is 1; "attr_index=4" indicates that the index number of the attribute component corresponding to this field is 4; "default_attr_flag=0" indicates that the attribute component corresponding to this field is not the default attribute component presented in the reflectivity type attribute component; "attr_label="repaired"" indicates that the attribute label of the attribute component corresponding to this field is "repaired".

[0190] Optionally, the content production device may also put Track1 and Track3 into one track group, and Track2 and Track4 into one track group; to indicate that the attribute components in Track1 and Track3 can be presented simultaneously, and the attribute components in Track2 and Track4 can be presented simultaneously.

[0191] Specifically, the AttrInsCombinationGroup of Track1 and Track3:

[0192] {track_group_id=100}

[0193] Here, “track_group_id=100” is used to indicate that the track group to which Track 1 and Track 3 belong is identified as “100”.

[0194] AttrInsCombinationGroup of Track2 and Track4:

[0195] {track_group_id=200}

[0196] Here, “track_group_id=200” is used to indicate that the track group to which Track2 and Track4 belong is identified as “200”.

[0197] The content production device transmits the media file of the point cloud media to the content consumption device.

[0198] In one implementation, the content consumption device directly downloads the complete file of the point cloud media and then presents the point cloud media.

[0199] In another implementation, the point cloud media file is sliced ​​into multiple media segments. The content consumption device establishes a streaming transmission with the content production device or the server (which stores the complete file of the point cloud media), and presents and consumes the media segments while receiving them. At this time, the content production device or the server generates a transmission signal and sends it to the content consumption device. The transmission signal contains the description information (GPCCMultiAttrInsInfodescriptor) of track1 to track4, as follows:

[0200] Representation 1 (corresponding to Track 1):

[0201] {GPCCMultiAttrInfo@defaultAttrFlag=1; GPCCMultiAttrInfo@attrLabel="original"; GPCCMultiAttrInfo@attrIndex=1; GPCCMultiAttrInfo@attrCombinationGroupId=100}

[0202] Representation 2 (corresponding to Track 2):

[0203] {GPCCMultiAttrInfo@defaultAttrFlag=0; GPCCMultiAttrInfo@attrLabel="repaired"; GPCCMultiAttrInfo@attrIndex=2; GPCCMultiAttrInfo@attrCombinationGroupId=200}

[0204] Representation 3 (corresponding to Track 3):

[0205] {GPCCMultiAttrInfo@defaultAttrFlag=1; GPCCMultiAttrInfo@attrLabel="original"; GPCCMultiAttrInfo@attrIndex=3; GPCCMultiAttrInfo@attrCombinationGroupId=100}

[0206] Representation 4 (corresponding to Track 4):

[0207] {GPCCMultiAttrInfo@defaultAttrFlag=0; GPCCMultiAttrInfo@attrLabel="repaired"; GPCCMultiAttrInfo@attrIndex=4; GPCCMultiAttrInfo@attrCombinationGroupId=200}

[0208] Among them, taking Representation1 as an example, "GPCCMultiAttrInsInfo@defaultAttrFlag=1" is used to indicate that the attribute component in track 1 is the default attribute component presented in the color type attribute component; "GPCCMultiAttrInsInfo@attrLabel="original"" is used to indicate that the attribute label of the attribute component in track 1 is "original"; "GPCCMultiAttrInsInfo@attrIndex=1" is used to indicate that the index number of the attribute component in track 1 is 1; "GPCCMultiAttrInsInfo@attrCombinationGroupId=100" is used to indicate that the identifier of the track group to which track 1 belongs is "100". The semantics of the syntax in Representation2-Representation4 can be referred to Representation1 and will not be repeated here.

[0209] The content consumption device parses and presents the media files or media segments of the point cloud media.

[0210] If the content consumption device has downloaded the complete file of the point cloud media, it can determine that track1 and track2 correspond to two color point cloud attribute instances, and track3 and track4 correspond to two reflectivity attribute instances based on the information in the above GPCCMultiAttrInsInfoBox (the content consumption device can index the corresponding attribute type information through attr_index). The attribute components in track1 and track3 are the attribute components presented by default. Since track1 and track3 have the same AttrInsCombinationGroup track group identifier, the attribute components in track1 and track3 need to be presented together; similarly, since track2 and track4 have the same AttrInsCombinationGroup track group identifier, the attribute components in track2 and track4 need to be presented together. Based on the information in the above GPCCMultiAttrInsInfoBox, the content consumption device presents the component data of the attribute components in track1 and track3 by default, and presents the component data of the attribute components in track2 and track4 at the target time (based on viewer interaction feedback or application algorithm).

[0211] If the content consumption device uses streaming to pull media segments of point cloud media, it will request the required media segments based on the description information in the signaling. For example, the content consumption device can first request the bitstream data corresponding to track 1 and track 3 for parsing and presentation. Then, at the target time (based on viewer interaction feedback or application algorithm), it will request the bitstream data corresponding to track 2 and track 4 for parsing and presentation. The specific implementation method can be referred to the implementation method in which the content consumption device downloads the complete file of point cloud media and performs parsing and presentation, which will not be repeated here.

[0212] In another embodiment, a content production device obtains point cloud data of a point cloud media, encodes the point cloud data to obtain code stream data of the point cloud media, generates attribute indication information based on the code stream data, and uses a single-track encapsulation mode to encapsulate the code stream data and the attribute indication information to obtain a media file of the point cloud media.

[0213] Assume that the bitstream data of the point cloud media contains one geometry component data, two color attribute component data, and two reflectivity attribute component data, and all component data of the point cloud media are encapsulated in a single track encapsulation mode, that is, all component data of the point cloud media are in one track. Then:

[0214] The attribute information corresponding to Track 1 is as follows:

[0215]

[0216] "attr_num=4" indicates that the number of attribute components with multi-attribute instance information contained in track 1 is 4; illustrated by "{attr_index=1; default_attr_flag=1; attr_label="original"}", "attr_index=1" indicates that the index number of the attribute component corresponding to the field is 1; "default_attr_flag=1" indicates that the attribute component corresponding to the field is the default attribute component among multiple attribute components of the same type; "attr_label="original"" indicates that the attribute label of the attribute component corresponding to the field is "original".

[0217] The content production device transmits the media file of the point cloud media to the content consumption device.

[0218] In one implementation, the content consumption device directly downloads the complete file of the point cloud media and then presents the point cloud media.

[0219] In another implementation, the point cloud media file is sliced ​​into multiple media segments. The content consumption device establishes a streaming transmission with the content production device or server (which stores the complete point cloud media file), and simultaneously presents and consumes the media segments. In this case, the content production device or server generates a transmission signal and sends it to the content consumption device. The transmission signal includes the description information of track1 (GPCCMultiAttrInsInfo descriptor), as follows:

[0220] {GPCCMultiAttrInfo@defaultAttrFlag=1; GPCCMultiAttrInfo@attrLabel="original"; GPCCMultiAttrInfo@attrIndex=1;}

[0221] {GPCCMultiAttrInfo@defaultAttrFlag=0; GPCCMultiAttrInfo@attrLabel="repaired"; GPCCMultiAttrInfo@attrIndex=2;}

[0222] {GPCCMultiAttrInfo@defaultAttrFlag=1; GPCCMultiAttrInfo@attrLabel="original"; GPCCMultiAttrInfo@attrIndex=3;}

[0223] {GPCCMultiAttrInfo@defaultAttrFlag=0; GPCCMultiAttrInfo@attrLabel="repaired"; GPCCMultiAttrInfo@attrIndex=4;}

[0224] Among them, "GPCCMultiAttrInsInfo@defaultAttrFlag=1" is used to indicate that the attribute component in track 1 is the default attribute component among multiple attribute components of the same type; "GPCCMultiAttrInsInfo@attrLabel="original"" is used to indicate that the attribute label of the attribute component in track 1 is "original"; "GPCCMultiAttrInsInfo@attrIndex=1" is used to indicate that the index number of the attribute component in track 1 is 1.

[0225] The content consumption device parses and presents the media files or media segments of the point cloud media.

[0226] If the content consumption device has downloaded the complete file of the point cloud media, it can be determined that track1 contains 4 point cloud attribute instances based on the information in the above GPCCMultiAttrInsInfoBox, which correspond to the attribute components of color type (attribute component with attr_index=1 and attribute component with attr_index=2), and attribute components of reflectivity type (attribute component with attr_index=3 and attribute component with attr_index=4); wherein the attribute component with attr_index=1 and the attribute component with attr_index=3 are the attribute components presented by default. Since the attribute component with attr_index=1 and the attribute component with attr_index=3 have the same label, the attribute component with attr_index=1 and the attribute component with attr_index=3 need to be presented together; similarly, since the attribute component with attr_index=2 and the attribute component with attr_index=4 have the same label, the attribute component with attr_index=2 and the attribute component with attr_index=4 need to be presented together. Based on the information in the above GPCCMultiAttrInsInfoBox, the content consumption device presents the component data of the attribute component attr_index=1 and the attribute component attr_index=3 by default, and at the target moment (based on viewer interaction feedback or application algorithm), presents the component data of the attribute component attr_index=2 and the attribute component attr_index=4.

[0227] If the content consumption device uses streaming transmission to pull the media segments of the point cloud media, the required media segments are requested according to the description information in the signaling. For example, the content consumption device can first request the stream data corresponding to the attribute component of attr_index=1 and the attribute component of attr_index=3 to be parsed and presented. And at the target moment (based on the viewer's interactive feedback or application algorithm), the stream data corresponding to the attribute component of attr_index=2 and the attribute component of attr_index=4 is requested to be parsed and presented. The specific implementation method can refer to the implementation method in which the content consumption device downloads the complete file of the point cloud media and performs parsing and presentation, which will not be repeated here.

[0228] In an embodiment of the present application, point cloud data of point cloud media is acquired and encoded to obtain bitstream data of the point cloud media. The bitstream data of the point cloud media includes at least two attribute components of the same type. Attribute indication information is generated based on the bitstream data. The attribute indication information is used to indicate the presentation method of the at least two attribute components of the same type. The bitstream data and the attribute indication information are encapsulated to obtain a media file of the point cloud media. It can be seen that the attribute indication information is used to describe the at least two attribute components of the same type, so that the content consumption device can parse and present the point cloud media according to the attribute indication information.

[0229] The above describes in detail the method of the embodiment of the present application. In order to facilitate better implementation of the above scheme of the embodiment of the present application, the device of the embodiment of the present application is provided below accordingly.

[0230] See Figure 4 , Figure 4 This is a schematic diagram of the structure of a point cloud media data processing device provided in an embodiment of the present application; the point cloud media data processing device can be a computer program (including program code) running on a content consumption device, for example, the point cloud media data processing device can be an application software in the content consumption device. Figure 4 As shown, the data processing device of the point cloud media includes an acquisition unit 401 and a processing unit 402.

[0231] See Figure 4 In an exemplary embodiment, the detailed description of each unit is as follows:

[0232] An acquisition unit 401 is configured to acquire a media file of a point cloud media, the media file including code stream data and attribute indication information of the point cloud media, the code stream data including at least two attribute components of the same type, and the attribute indication information indicating a presentation method of the at least two attribute components of the same type;

[0233] The processing unit 402 is configured to parse and present the point cloud media according to the attribute indication information and the code stream data.

[0234] In one embodiment, the attribute indication information includes a multi-attribute instance information data box, where the multi-attribute instance information data box is used to indicate description information of at least two attribute components of the same type.

[0235] In one embodiment, at least two attribute components of the same type are encapsulated in one or more tracks, and the at least two attribute components of the same type have multi-attribute instance information. The multi-attribute instance information data box includes an attribute quantity field. The processing unit 402 is configured to parse the point cloud media based on the attribute indication information and the bitstream data, specifically to:

[0236] According to the attribute quantity field, the number of attribute components with multi-attribute instance information in the track corresponding to the attribute quantity field is determined.

[0237] In one embodiment, the multi-attribute instance information data box includes a default attribute flag field; the processing unit 402 is configured to parse the point cloud media according to the attribute indication information and the bitstream data, specifically to:

[0238] If the value of the default attribute flag field is the first set value, determining that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type;

[0239] If the value of the default attribute flag field is the second set value, it is determined that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0240] In one embodiment, the attribute indication information includes a component information data box, and the component information data box includes description information of each component in the code stream data.

[0241] In one embodiment, the component information data box includes an attribute information flag field; the processing unit 402 is configured to parse the point cloud media according to the attribute indication information and the bitstream data, specifically to:

[0242] If the value of the attribute information flag field is the first set value, determining that the data box corresponding to the attribute information flag field contains description information of the attribute component;

[0243] If the value of the attribute information flag field is the second set value, it is determined that the data box corresponding to the attribute information flag field does not contain description information of the attribute component.

[0244] In one embodiment, the component information data box includes a default attribute flag field; the processing unit 402 is configured to parse the point cloud media according to the attribute indication information and the bitstream data, specifically to:

[0245] If the value of the default attribute flag field is the first set value, determining that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type;

[0246] If the value of the default attribute flag field is the second set value, it is determined that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0247] In one embodiment, the attribute indication information includes an attribute tag field, and the bitstream data includes at least two attribute components with the same value in the attribute tag field; the processing unit 402 is configured to present the point cloud media based on the attribute indication information and the bitstream data, specifically to:

[0248] Render at least two attribute components with the same attribute label field value at the same time.

[0249] In one embodiment, the code stream data includes a plurality of attribute components belonging to a first type and a plurality of attribute components belonging to a second type;

[0250] Each attribute component is encapsulated in a track, and the attribute indication information includes track group indication information, where the track group indication information is used to indicate attribute components that are presented simultaneously.

[0251] In one embodiment, the track group indication information includes a track group identification field; the processing unit 402 is configured to parse the point cloud media according to the attribute indication information and the bitstream data, specifically to:

[0252] According to the track group identification field, determine the track group to which the track corresponding to the track group identification field belongs;

[0253] The track group indication information further includes a track group type field, which is used to indicate the type of track group to which the track corresponding to the track group type field belongs. The processing unit 402 is further configured to:

[0254] If there are at least two tracks whose track group identification fields have the same value, and at least two tracks whose track group type fields have the same value, it is determined that the at least two tracks belong to the same track group.

[0255] In one embodiment, the processing unit 402 is configured to present point cloud media based on the attribute indication information and the bitstream data, specifically to:

[0256] Renders all property components belonging to the same track group simultaneously.

[0257] According to one embodiment of the present application, Figure 2 Some of the steps involved in the data processing method of the point cloud media shown can be represented by Figure 4 The data processing unit of the point cloud media shown is executed by each unit. For example, Figure 2 The step S201 shown in FIG. Figure 4 The acquisition unit 401 shown in FIG. 4 is executed, and step S202 can be performed by Figure 4 Processing unit 402 is shown executing. Figure 4The various units in the data processing device of the point cloud media shown can be individually or completely combined into one or several other units to form a whole, or one (or some) of the units can be further divided into multiple functionally smaller units to form a whole, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In actual applications, the functions of one unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the data processing device of the point cloud media may also include other units. In actual applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.

[0258] According to another embodiment of the present application, the program can be executed by running on a general computing device such as a computer including a central processing unit (CPU), a random access memory (RAM), a read-only memory (ROM) and other processing elements and storage elements. Figure 2 A computer program (including program code) for each step involved in the corresponding method shown in Figure 4 The point cloud media data processing device shown in , and the point cloud media data processing method of the present application are implemented. The computer program can be recorded on, for example, a computer-readable recording medium, and loaded into the above-mentioned computing device via the computer-readable recording medium and executed therein.

[0259] Based on the same inventive concept, the principles and beneficial effects of solving problems by the point cloud media data processing device provided in the embodiment of the present application are similar to the principles and beneficial effects of solving problems by the point cloud media data processing method in the method embodiment of the present application. Please refer to the principles and beneficial effects of the implementation of the method. For the sake of concise description, they will not be repeated here.

[0260] See Figure 5 , Figure 5 This is a schematic diagram of the structure of another point cloud media data processing device provided in an embodiment of the present application; the point cloud media data processing device can be a computer program (including program code) running in a content production device, for example, the point cloud media data processing device can be an application software in the content production device. Figure 5 As shown, the data processing device of the point cloud media includes an acquisition unit 501 and a processing unit 502. Figure 5 , the detailed description of each unit is as follows:

[0261] An acquisition unit 501 is configured to acquire point cloud data of a point cloud media and encode the point cloud data to obtain bitstream data of the point cloud media, wherein the bitstream data of the point cloud media includes at least two attribute components of the same type.

[0262] The processing unit 502 is configured to generate attribute indication information according to the code stream data, where the attribute indication information is used to indicate a presentation mode of at least two attribute components of the same type;

[0263] It is also used to encapsulate the code stream data and attribute indication information to obtain a media file of the point cloud media.

[0264] In one embodiment, the attribute indication information includes a multi-attribute instance information data box, where the multi-attribute instance information data box is used to indicate description information of at least two attribute components of the same type.

[0265] In one embodiment, at least two attribute components of the same type are encapsulated in one or more tracks, and at least two attribute components of the same type have multiple attribute instance information;

[0266] The multi-attribute instance information data box includes an attribute quantity field, which is used to indicate the number of attribute components with multi-attribute instance information in the track corresponding to the attribute quantity field.

[0267] In one embodiment, the multi-attribute instance information data box includes a default attribute flag field;

[0268] When the default attribute flag field takes the first set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type;

[0269] When the value of the default attribute flag field is the second set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0270] In one embodiment, the attribute indication information includes a component information data box, and the component information data box includes description information of each component in the code stream data.

[0271] In one embodiment, the component information data box includes an attribute information flag field; the attribute information flag field is used to indicate whether the component information data box includes description information of the attribute component;

[0272] When the attribute information flag field takes the first set value, it is used to indicate that the component information data box contains description information of the attribute component;

[0273] When the attribute information flag field takes the second set value, it is used to indicate that the component information data box does not contain description information of the attribute component.

[0274] In one embodiment, the component information data box includes a default attribute flag field;

[0275] When the default attribute flag field takes the first set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type;

[0276] When the value of the default attribute flag field is the second set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0277] In one embodiment, the attribute indication information includes an attribute tag field;

[0278] If the values ​​of the attribute tag fields corresponding to at least two attribute components are the same, it means that at least two attribute components can be presented at the same time.

[0279] In one embodiment, the code stream data includes a plurality of attribute components belonging to a first type and a plurality of attribute components belonging to a second type;

[0280] Each attribute component is encapsulated in a track, and the attribute indication information includes track group indication information, where the track group indication information is used to indicate attribute components that are presented simultaneously.

[0281] In one embodiment, the track group indication information includes a track group identification field, where the track group identification field is used to indicate the track group to which the track corresponding to the track group identification field belongs;

[0282] The track group indication information further includes a track group type field, which is used to indicate the type of the track group to which the track corresponding to the track group type field belongs;

[0283] If the values ​​of the Track Group Identification fields of at least two tracks are the same, and the values ​​of the Track Group Type fields of at least two tracks are the same, it means that at least two tracks belong to the same track group.

[0284] According to one embodiment of the present application, Figure 3 Some of the steps involved in the data processing method of the point cloud media shown can be represented by Figure 5 The data processing unit of the point cloud media shown is executed by each unit. For example, Figure 3 The step S301 shown in FIG. Figure 5 The acquisition unit 501 shown in FIG. 5 is executed, and steps S302 and S303 can be performed by Figure 5 Processing unit 502 is shown executing. Figure 5The various units in the data processing device of the point cloud media shown can be individually or completely combined into one or several other units to form a whole, or one (or some) of the units can be further divided into multiple functionally smaller units to form a whole, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In actual applications, the functions of one unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the data processing device of the point cloud media may also include other units. In actual applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.

[0285] According to another embodiment of the present application, the program can be executed by running on a general computing device such as a computer including a central processing unit (CPU), a random access memory (RAM), a read-only memory (ROM) and other processing elements and storage elements. Figure 3 A computer program (including program code) for each step involved in the corresponding method shown in Figure 5 The point cloud media data processing device shown in , and the point cloud media data processing method of the present application are implemented. The computer program can be recorded on, for example, a computer-readable recording medium, and loaded into the above-mentioned computing device via the computer-readable recording medium and executed therein.

[0286] Based on the same inventive concept, the principles and beneficial effects of solving problems by the point cloud media data processing device provided in the embodiment of the present application are similar to the principles and beneficial effects of solving problems by the point cloud media data processing method in the method embodiment of the present application. Please refer to the principles and beneficial effects of the implementation of the method. For the sake of concise description, they will not be repeated here.

[0287] Figure 6 This is a structural diagram of a content consumption device provided in an embodiment of the present application; the content consumption device may refer to a computer device used by a user of point cloud media, and the computer device may be a terminal (such as a PC, a smart mobile device (such as a smartphone), a VR device (such as a VR helmet, VR glasses, etc.)). Figure 6 As shown, the content consumption device includes a receiver 601, a processor 602, a memory 603, and a display / playback device 604.

[0288] The receiver 601 is used to implement decoding and transmission interaction with other devices, specifically to implement the transmission of point cloud media between the content production device and the content consumption device. That is, the content consumption device receives the relevant media resources of the point cloud media transmitted by the content production device through the receiver 601.

[0289] The processor 602 (also called CPU (Central Processing Unit)) is the processing core of the content production device. The processor 602 is suitable for implementing one or more program instructions, and is specifically suitable for loading and executing one or more program instructions to achieve Figure 2 The flow of the point cloud media data processing method is shown.

[0290] The memory 603 is a memory device in the content consumption device, which is used to store programs and media resources. It is understandable that the memory 603 here can include both the built-in storage medium in the content consumption device and the extended storage medium supported by the content consumption device. It should be noted that the memory 603 can be a high-speed RAM memory or a non-volatile memory, such as at least one disk memory; optionally, it can also be at least one memory located away from the aforementioned processor. The memory 603 provides a storage space, which is used to store the operating system of the content consumption device. In addition, the storage space is also used to store a computer program, which includes program instructions, and the program instructions are suitable for being called and executed by the processor to execute the various steps of the point cloud media data processing method. In addition, the memory 603 can also be used to store the three-dimensional image of the point cloud media formed after processing by the processor, the audio content corresponding to the three-dimensional image, and the information required for rendering the three-dimensional image and audio content.

[0291] The display / playback device 604 is used to output the rendered sound and three-dimensional image.

[0292] See also Figure 6 , the processor 602 may include a parser 621, a decoder 622, a converter 623 and a renderer 624; wherein:

[0293] The parser 621 is used to decapsulate the encapsulated files of the rendering media from the content production device. Specifically, it decapsulates the media file resources according to the file format requirements of the point cloud media to obtain audio code streams and video code streams; and provides the audio code streams and video code streams to the decoder 622.

[0294] Decoder 622 decodes the audio stream to obtain audio content and provides it to the renderer for audio rendering. Decoder 622 also decodes the video stream to obtain a 2D image. Based on the metadata provided by the media presentation description, if the metadata indicates that the point cloud media has undergone a region encapsulation process, the 2D image is a encapsulated image; if the metadata indicates that the point cloud media has not undergone a region encapsulation process, the planar image is a projected image.

[0295] Converter 623 converts 2D images into 3D images. If the point cloud media has undergone region packing, converter 623 will first perform region unpacking on the packed image to obtain a projected image. This projected image is then reconstructed to produce a 3D image. If the rendering media has not undergone region packing, converter 623 will directly reconstruct the projected image to produce a 3D image.

[0296] The renderer 624 is used to render the audio content and 3D images of the point cloud media. Specifically, the renderer 624 renders the audio content and 3D images based on the rendering and viewport-related metadata in the media presentation description information. After the rendering is completed, the rendering is output to the display / playback device.

[0297] In an exemplary embodiment, the processor 602 (specifically, each device included in the processor) executes by calling one or more instructions in the memory. Figure 2 Specifically, the memory stores one or more first instructions, which are suitable for being loaded by the processor 602 and executed as follows:

[0298] Obtaining a media file of point cloud media, where the media file includes code stream data and attribute indication information of the point cloud media, where the code stream data includes at least two attribute components of the same type, and the attribute indication information is used to indicate a presentation method of the at least two attribute components of the same type;

[0299] Parse and present point cloud media based on attribute indication information and code stream data.

[0300] In one embodiment, the attribute indication information includes a multi-attribute instance information data box, where the multi-attribute instance information data box is used to indicate description information of at least two attribute components of the same type.

[0301] In one embodiment, at least two attribute components of the same type are encapsulated in one or more tracks, and the at least two attribute components of the same type have multi-attribute instance information. The multi-attribute instance information data box includes an attribute quantity field. The processor 602 parses the point cloud media according to the attribute indication information and the bitstream data in a specific embodiment as follows:

[0302] According to the attribute quantity field, the number of attribute components with multi-attribute instance information in the track corresponding to the attribute quantity field is determined.

[0303] In one embodiment, the multi-attribute instance information data box includes a default attribute flag field; the processor 602 parses the point cloud media according to the attribute indication information and the bitstream data. A specific embodiment is as follows:

[0304] If the value of the default attribute flag field is the first set value, determining that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type;

[0305] If the value of the default attribute flag field is the second set value, it is determined that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0306] In one implementation, the attribute indication information includes a component information data box, and the component information data box includes description information of each component in the code stream data.

[0307] In one embodiment, the component information data box includes an attribute information flag field; the processor 602 parses the point cloud media according to the attribute indication information and the bitstream data. A specific embodiment is as follows:

[0308] If the value of the attribute information flag field is the first set value, determining that the data box corresponding to the attribute information flag field contains description information of the attribute component;

[0309] If the value of the attribute information flag field is the second set value, it is determined that the data box corresponding to the attribute information flag field does not contain description information of the attribute component.

[0310] In one embodiment, the media component information data box includes a default attribute flag field; the processor 602 parses the point cloud media according to the attribute indication information and the bitstream data. A specific embodiment is as follows:

[0311] If the value of the default attribute flag field is the first set value, determining that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type;

[0312] If the value of the default attribute flag field is the second set value, it is determined that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0313] In one embodiment, the attribute indication information includes an attribute tag field, and the bitstream data includes at least two attribute components with the same value in the attribute tag field. The processor 602 presents the point cloud media according to the attribute indication information and the bitstream data in a specific embodiment as follows:

[0314] Render at least two attribute components with the same attribute label field value at the same time.

[0315] In one embodiment, the code stream data includes a plurality of attribute components belonging to a first type and a plurality of attribute components belonging to a second type;

[0316] Each attribute component is encapsulated in a track, and the attribute indication information includes track group indication information, where the track group indication information is used to indicate attribute components that are presented simultaneously.

[0317] In one embodiment, the track group indication information includes a track group identification field; the processor 602 parses the point cloud media according to the attribute indication information and the bitstream data. A specific embodiment is as follows:

[0318] According to the track group identification field, determine the track group to which the track corresponding to the track group identification field belongs;

[0319] The track group indication information further includes a track group type field, which is used to indicate the type of track group to which the track corresponding to the track group type field belongs. The computer program in the memory 603 is loaded by the processor 602 and further executes the following steps:

[0320] If there are at least two tracks whose track group identification fields have the same value, and at least two tracks whose track group type fields have the same value, it is determined that the at least two tracks belong to the same track group.

[0321] In one implementation, the processor 602 presents the point cloud media according to the attribute indication information and the bitstream data in the following specific embodiments:

[0322] Renders all property components belonging to the same track group simultaneously.

[0323] Based on the same inventive concept, the principles and beneficial effects of solving the problems of the content consumption device provided in the embodiment of the present application are similar to the principles and beneficial effects of solving the problems of the point cloud media data processing method in the method embodiment of the present application. Please refer to the principles and beneficial effects of the implementation of the method. For the sake of concise description, they will not be repeated here.

[0324] Figure 7 This is a structural diagram of a content production device provided in an embodiment of the present application; the content production device may refer to a computer device used by a provider of point cloud media, which may be a terminal (such as a PC, a smart mobile device (such as a smart phone), etc.) or a server. Figure 7 As shown, the content production device includes a capture device 701, a processor 702, a memory 703 and a transmitter 704.

[0325] Capture device 701 is used to capture real-world audio-visual scenes to obtain raw data of point cloud media (including audio and video content synchronized in time and space). Capture device 701 may include, but is not limited to, audio equipment, video equipment, and sensor equipment. Audio equipment may include audio sensors and microphones. Video equipment may include standard cameras, stereo cameras, light field cameras, etc. Sensor equipment may include laser equipment, radar equipment, etc.

[0326] The processor 702 (also called CPU (Central Processing Unit)) is the processing core of the content production device. The processor 702 is suitable for implementing one or more program instructions, and is specifically suitable for loading and executing one or more program instructions to achieve Figure 3 The flow of the point cloud media data processing method is shown.

[0327] The memory 703 is a memory device in the content production device, which is used to store programs and media resources. It is understandable that the memory 703 here can include both the built-in storage medium in the content production device and the extended storage medium supported by the content production device. It should be noted that the memory can be a high-speed RAM memory or a non-volatile memory, such as at least one disk memory; optionally, it can also be at least one memory located away from the aforementioned processor. The memory provides a storage space, which is used to store the operating system of the content production device. In addition, the storage space is also used to store a computer program, which includes program instructions, and the program instructions are suitable for being called and executed by the processor to execute the various steps of the point cloud media data processing method. In addition, the memory 703 can also be used to store point cloud media files formed after processing by the processor, and the point cloud media files include media file resources and media presentation description information.

[0328] The transmitter 704 is used to implement transmission interaction between the content production device and other devices, specifically to implement the transmission of point cloud media between the content production device and the content playback device. That is, the content production device transmits the relevant media resources of the point cloud media to the content playback device through the transmitter 704.

[0329] See also Figure 7 , the processor 702 may include a converter 721, an encoder 722 and a packager 723; wherein:

[0330] Converter 721 is used to perform a series of conversion processes on the captured video content, making it suitable for point cloud media video encoding. This conversion process may include stitching and projection, and optionally, region packing. Converter 721 can convert the captured 3D video content into 2D images and provide them to the encoder for video encoding.

[0331] The encoder 722 is used to perform audio encoding on the captured audio content to form an audio code stream of the point cloud media, and is also used to perform video encoding on the 2D image converted by the converter 721 to obtain a video code stream.

[0332] The encapsulator 723 is used to encapsulate the audio and video streams into a file container according to the point cloud media file format (such as ISOBMFF) to form a media file resource for the point cloud media. The media file resource can be a media file or a media fragment to form a media file for the point cloud media. The encapsulator also uses media presentation description information to record metadata for the point cloud media file resource according to the requirements of the point cloud media file format. The encapsulated point cloud media file generated by the encapsulator is stored in a memory and provided to a content playback device on demand for point cloud media presentation.

[0333] The processor 702 (specifically, each device included in the processor) executes by calling one or more instructions in the memory Figure 4 Specifically, the memory 703 stores one or more first instructions, which are suitable for being loaded by the processor 702 and executed as follows:

[0334] Acquiring point cloud data of the point cloud media, and encoding the point cloud data to obtain code stream data of the point cloud media, wherein the code stream data of the point cloud media includes at least two attribute components of the same type;

[0335] Generate attribute indication information according to the code stream data, where the attribute indication information is used to indicate a presentation mode of at least two attribute components of the same type;

[0336] The code stream data and attribute indication information are encapsulated to obtain a media file of the point cloud media.

[0337] In one embodiment, the attribute indication information includes a multi-attribute instance information data box, where the multi-attribute instance information data box is used to indicate description information of at least two attribute components of the same type.

[0338] In one embodiment, at least two attribute components of the same type are encapsulated in one or more tracks, and at least two attribute components of the same type have multiple attribute instance information;

[0339] The multi-attribute instance information data box includes an attribute quantity field, which is used to indicate the number of attribute components with multi-attribute instance information in the track corresponding to the attribute quantity field.

[0340] In one embodiment, the multi-attribute instance information data box includes a default attribute flag field;

[0341] When the default attribute flag field takes the first set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type;

[0342] When the value of the default attribute flag field is the second set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0343] In one implementation, the attribute indication information includes a component information data box, and the component information data box includes description information of each component in the code stream data.

[0344] In one embodiment, the component information data box includes an attribute information flag field; the attribute information flag field is used to indicate whether the component information data box includes description information of the attribute component;

[0345] When the attribute information flag field takes the first set value, it is used to indicate that the component information data box contains description information of the attribute component;

[0346] When the attribute information flag field takes the second set value, it is used to indicate that the component information data box does not contain description information of the attribute component.

[0347] In one embodiment, the component information data box includes a default attribute flag field;

[0348] When the default attribute flag field takes the first set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among at least two attribute components of the same type;

[0349] When the value of the default attribute flag field is the second set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among at least two attribute components of the same type.

[0350] In one embodiment, the attribute indication information includes an attribute tag field;

[0351] If the values ​​of the attribute tag fields corresponding to at least two attribute components are the same, it means that at least two attribute components can be presented at the same time.

[0352] In one embodiment, the code stream data includes a plurality of attribute components belonging to a first type and a plurality of attribute components belonging to a second type;

[0353] Each attribute component is encapsulated in a track, and the attribute indication information includes track group indication information, where the track group indication information is used to indicate attribute components that are presented simultaneously.

[0354] In one embodiment, the track group indication information includes a track group identification field, where the track group identification field is used to indicate the track group to which the track corresponding to the track group identification field belongs;

[0355] The track group indication information further includes a track group type field, which is used to indicate the type of the track group to which the track corresponding to the track group type field belongs;

[0356] If the values ​​of the Track Group Identification fields of at least two tracks are the same, and the values ​​of the Track Group Type fields of at least two tracks are the same, it means that at least two tracks belong to the same track group.

[0357] Based on the same inventive concept, the principles and beneficial effects of solving the problems of the content production device provided in the embodiment of the present application are similar to the principles and beneficial effects of solving the problems of the point cloud media data processing method in the method embodiment of the present application. Please refer to the principles and beneficial effects of the implementation of the method. For the sake of concise description, they will not be repeated here.

[0358] An embodiment of the present application also provides a computer-readable storage medium, in which one or more instructions are stored. The one or more instructions are suitable for being loaded by a processor and executing the point cloud media data processing method of the above method embodiment.

[0359] An embodiment of the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the point cloud media data processing method of the above method embodiment.

[0360] The present application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the aforementioned point cloud media data processing method.

[0361] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0362] The modules in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0363] A person skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, which can include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0364] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Ordinary technicians in this field can understand that all or part of the processes of the above embodiment and equivalent changes made in accordance with the claims of this application are still within the scope covered by the application.

Claims

1. A method for processing point cloud media data, characterized in that: The method comprises: Obtaining a media file of point cloud media, the media file comprising code stream data and attribute indication information of the point cloud media, the code stream data comprising at least two attribute components of the same type, the attribute indication information being used to indicate a presentation manner of the at least two attribute components of the same type; each of the at least two attribute components of the same type comprising multiple attribute instance information; and the attribute indication information comprising an attribute tag field; The point cloud media is parsed and presented according to the attribute indication information and the code stream data; wherein, when the code stream data contains at least two attribute components with the same attribute tag field value, the attribute components with the same attribute tag field value are presented simultaneously.

2. The method according to claim 1, wherein The attribute indication information includes a multi-attribute instance information data box, and the multi-attribute instance information data box is used to indicate description information of the at least two attribute components belonging to the same type.

3. The method according to claim 2, wherein The at least two attribute components of the same type are encapsulated in one or more tracks, the at least two attribute components of the same type have multi-attribute instance information, and the multi-attribute instance information data box includes an attribute quantity field; parsing the point cloud media according to the attribute indication information and the code stream data includes: According to the attribute quantity field, the number of attribute components having multi-attribute instance information in the track corresponding to the attribute quantity field is determined.

4. The method according to claim 2, wherein The multi-attribute instance information data box includes a default attribute flag field; and parsing the point cloud media according to the attribute indication information and the code stream data includes: If the value of the default attribute flag field is the first set value, determining that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among the at least two attribute components of the same type; If the value of the default attribute flag field is the second set value, it is determined that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among the at least two attribute components of the same type.

5. The method according to claim 1, wherein The attribute indication information includes a component information data box, and the component information data box includes description information of each component in the code stream data.

6. The method according to claim 5, wherein The component information data box includes an attribute information flag field; parsing the point cloud media according to the attribute indication information and the code stream data includes: If the value of the attribute information flag field is the first set value, determining that the data box corresponding to the attribute information flag field contains description information of the attribute component; If the value of the attribute information flag field is the second set value, it is determined that the data box corresponding to the attribute information flag field does not include description information of the attribute component.

7. The method according to claim 5, wherein The component information data box includes a default attribute flag field; and parsing the point cloud media according to the attribute indication information and the code stream data includes: If the value of the default attribute flag field is the first set value, determining that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among the at least two attribute components of the same type; If the value of the default attribute flag field is the second set value, it is determined that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among the at least two attribute components of the same type.

8. The method according to claim 1 or 2, wherein: The code stream data includes a plurality of attribute components belonging to a first type and a plurality of attribute components belonging to a second type; Each attribute component is encapsulated in a track, and the attribute indication information includes track group indication information, where the track group indication information is used to indicate attribute components that are presented simultaneously.

9. The method according to claim 8, wherein The track group indication information includes a track group identification field; and parsing the point cloud media according to the attribute indication information and the code stream data includes: Determining, according to the track group identification field, the track group to which the track corresponding to the track group identification field belongs; The track group indication information further includes a track group type field, where the track group type field is used to indicate the type of the track group to which the track corresponding to the track group type field belongs. The method further includes: If there are at least two tracks whose track group identification fields have the same value, and the track group type fields of the at least two tracks have the same value, it is determined that the at least two tracks belong to the same track group.

10. The method according to claim 9, wherein The presenting the point cloud media according to the attribute indication information and the code stream data includes: Renders all property components belonging to the same track group simultaneously.

11. A method for processing point cloud media data, characterized in that: The method comprises: Acquiring point cloud data of a point cloud media, and encoding the point cloud data to obtain code stream data of the point cloud media, wherein the code stream data of the point cloud media includes at least two attribute components of the same type; each of the at least two attribute components of the same type has multiple attribute instance information; generating attribute indication information according to the code stream data, wherein the attribute indication information is used to indicate a presentation mode of the at least two attribute components belonging to the same type; the attribute indication information includes an attribute tag field; The code stream data and the attribute indication information are encapsulated to obtain a media file of the point cloud media; wherein, if the values ​​of the attribute tag fields corresponding to at least two attribute components are the same, it means that the at least two attribute components can be presented simultaneously.

12. The method according to claim 11, wherein The attribute indication information includes a multi-attribute instance information data box, and the multi-attribute instance information data box is used to indicate description information of the at least two attribute components belonging to the same type.

13. The method according to claim 12, wherein: The at least two attribute components of the same type are encapsulated in one or more tracks, and the at least two attribute components of the same type have multiple attribute instance information; The multi-attribute instance information data box includes an attribute quantity field, and the attribute quantity field is used to indicate the number of attribute components having multi-attribute instance information in the track corresponding to the attribute quantity field.

14. The method according to claim 12, wherein: The multi-attribute instance information data box includes a default attribute flag field; When the value of the default attribute flag field is the first set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among the at least two attribute components of the same type; When the value of the default attribute flag field is the second set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among the at least two attribute components belonging to the same type.

15. The method according to claim 11, wherein The attribute indication information includes a component information data box, and the component information data box includes description information of each component in the code stream data.

16. The method according to claim 15, wherein The component information data box includes an attribute information flag field; the attribute information flag field is used to indicate whether the component information data box includes description information of the attribute component; When the attribute information flag field takes the first set value, it is used to indicate that the component information data box contains description information of the attribute component; When the attribute information flag field takes the second set value, it is used to indicate that the component information data box does not include description information of the attribute component.

17. The method according to claim 15, wherein The component information data box includes a default attribute flag field; When the value of the default attribute flag field is the first set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is the attribute component presented by default among the at least two attribute components of the same type; When the value of the default attribute flag field is the second set value, it is used to indicate that the attribute component corresponding to the default attribute flag field is not the attribute component presented by default among the at least two attribute components belonging to the same type.

18. The method according to claim 11 or 12, wherein: The code stream data includes a plurality of attribute components belonging to a first type and a plurality of attribute components belonging to a second type; Each attribute component is encapsulated in a track, and the attribute indication information includes track group indication information, where the track group indication information is used to indicate attribute components that are presented simultaneously.

19. The method according to claim 18, wherein The track group indication information includes a track group identification field, where the track group identification field is used to indicate the track group to which the track corresponding to the track group identification field belongs; The track group indication information further includes a track group type field, where the track group type field is used to indicate the type of the track group to which the track corresponding to the track group type field belongs; If the values ​​of the track group identification fields of at least two tracks are the same, and the values ​​of the track group type fields of the at least two tracks are the same, it means that the at least two tracks belong to the same track group.

20. A point cloud media data processing device, characterized in that: The data processing device of the point cloud media includes: an acquisition unit, configured to acquire a media file of point cloud media, the media file comprising code stream data and attribute indication information of the point cloud media, the code stream data comprising at least two attribute components of the same type, the attribute indication information being used to indicate a presentation manner of the at least two attribute components of the same type; each of the at least two attribute components of the same type comprising multiple attribute instance information; and the attribute indication information comprising an attribute tag field; a processing unit, configured to parse and present the point cloud media according to the attribute indication information and the code stream data; When the code stream data includes at least two attribute components with the same attribute tag field value, the processing unit is configured to simultaneously present the at least two attribute components with the same attribute tag field value.

21. A point cloud media data processing device, characterized in that: The data processing device of the point cloud media includes: an acquisition unit, configured to acquire point cloud data of a point cloud media and perform encoding processing on the point cloud data to obtain code stream data of the point cloud media, wherein the code stream data of the point cloud media includes at least two attribute components of the same type; each of the at least two attribute components of the same type has multi-attribute instance information; a processing unit, configured to generate attribute indication information according to the code stream data, wherein the attribute indication information is used to indicate a presentation mode of the at least two attribute components belonging to the same type; the attribute indication information includes an attribute tag field; And it is used to encapsulate the code stream data and the attribute indication information to obtain a media file of the point cloud media; wherein, if the values ​​of the attribute tag fields corresponding to at least two attribute components are the same, it means that the at least two attribute components can be presented simultaneously.

22. A computer device, characterized in that: include: storage devices and processors; a memory storing a computer program; A processor, used to load the computer program to implement the data processing method of point cloud media as described in any one of claims 1-10; or used to load the computer program to implement the data processing method of point cloud media as described in any one of claims 11-19.

23. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which is suitable for being loaded by a processor and executing the data processing method for point cloud media as described in any one of claims 1-10; or loading and executing the data processing method for point cloud media as described in any one of claims 11-19.

Images