Point cloud coding method and apparatus, computer-readable medium, and electronic device

Abstract

This application belongs to the field of computer and communication technology, specifically relating to a point cloud encoding / decoding method, a point cloud encoding / decoding device, a computer-readable medium, and an electronic device. The point cloud decoding method in this application includes: receiving a point cloud file transmitted from a data source, the point cloud file including point cloud media tracks with the same point cloud content but different point cloud qualities; parsing the file encapsulation information of the point cloud media tracks to obtain quality indication information carried in the file encapsulation information, the quality indication information representing the point cloud quality of the point cloud media tracks, the point cloud quality including at least one of the bitrate and frame rate of the point cloud bitstream; and selecting and decoding a point cloud media track with a specified point cloud quality from the point cloud file according to the quality indication information carried in the file encapsulation information. This application embodiment can clearly indicate the quality level of point cloud files and file components, thereby enabling flexible and accurate selection of suitable point cloud data in point cloud data encoding / decoding and data transmission.

Description

[0001] This application is a divisional application of the invention patent application with application number 202110351657.2, application date March 31, 2021, entitled "Point Cloud Encoding and Decoding Method, Apparatus, Computer-Readable Medium and Electronic Device". Technical Field

[0002] This application belongs to the field of computer and communication technology, and specifically relates to a point cloud encoding and decoding method, a point cloud encoding and decoding device, a computer-readable medium, and an electronic device. Background Technology

[0003] Point clouds are a set of discrete points in space that are randomly distributed and represent the spatial structure and surface properties of three-dimensional objects or scenes. After acquiring large-scale point cloud data through point cloud acquisition devices, the point cloud data can be encoded and encapsulated for transmission and presentation to users. However, how to transmit point cloud data suitable for network and device conditions is a problem that urgently needs to be solved. Summary of the Invention

[0004] The purpose of this application is to provide a point cloud encoding and decoding method, a point cloud encoding and decoding device, a computer-readable medium, and an electronic device, which at least to some extent overcomes the technical problem of poor flexibility in point cloud data transmission in related technologies.

[0005] Other features and advantages of this application will become apparent from the following detailed description, or may be learned in part from practice of this application.

[0006] According to one aspect of the embodiments of this application, a point cloud decoding method is provided. The method includes: receiving a point cloud file transmitted by a data source, the point cloud file including point cloud media tracks having the same point cloud content but different point cloud qualities; parsing the file encapsulation information of the point cloud media tracks to obtain quality indication information carried in the file encapsulation information, the quality indication information being used to indicate the point cloud quality of the point cloud media tracks, the point cloud quality including at least one of the bitrate and frame rate of the point cloud bitstream; and selecting and decoding a point cloud media track with a specified point cloud quality from the point cloud file according to the quality indication information carried in the file encapsulation information.

[0007] According to one aspect of the embodiments of this application, a point cloud decoding apparatus is provided, the apparatus comprising: a receiving module configured to receive a point cloud file transmitted by a data source, the point cloud file including point cloud media tracks having the same point cloud content but different point cloud qualities; a parsing module configured to parse file encapsulation information of the point cloud media tracks to obtain quality indication information carried in the file encapsulation information, the quality indication information being used to indicate the point cloud quality of the point cloud media tracks, the point cloud quality including at least one of bitrate and frame rate of the point cloud bitstream; and a decoding module configured to select and decode a point cloud media track having a specified point cloud quality from the point cloud file according to the quality indication information carried in the file encapsulation information.

[0008] In some embodiments of this application, based on the above technical solutions, the receiving module includes: a signaling receiving unit configured to receive streaming media signaling sent by a data source for transmitting point cloud data; a signaling parsing unit configured to parse the streaming media signaling to obtain at least two selectable quality indication information carried in the streaming media signaling; a request sending unit configured to send a data transmission request to the data source according to the quality indication information carried in the streaming media signaling; and a file receiving unit configured to receive a point cloud file transmitted by the data source corresponding to the data transmission request.

[0009] In some embodiments of this application, based on the above technical solutions, the request sending unit includes: a bandwidth acquisition subunit configured to acquire the network bandwidth for data transmission with the data source; a bandwidth matching subunit configured to match and detect the network bandwidth with the quality indication information carried in the streaming media signaling to select a target point cloud quality that matches the network bandwidth; and a request sending subunit configured to send a data transmission request generated based on the target point cloud quality to the data source.

[0010] In some embodiments of this application, based on the above technical solutions, the parsing module includes: an information parsing unit configured to parse the file encapsulation information of the point cloud media track to determine at least one quality indicator field related to the quality parameters of the point cloud media track; and an information determining unit configured to determine the quality indicator information of the point cloud media file based on the value of the quality indicator field.

[0011] In some embodiments of this application, based on the above technical solutions, the quality indication information includes at least one of the following: true quality value, equivalent quality value, and quality grade; wherein, the true quality value is the parameter value of the quality parameter, the equivalent quality value is the quantity of unit quality parameters obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter, and the quality grade is grade information used to represent the range of parameter values ​​of the quality parameter.

[0012] In some embodiments of this application, based on the above technical solutions, the quality parameters include at least one of the bitrate and frame rate of the point cloud bitstream.

[0013] According to one aspect of the embodiments of this application, a point cloud encoding method is provided. The method includes: encoding point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams with the same point cloud content but different point cloud qualities, wherein the point cloud quality includes at least one of the bit rate and frame rate of the point cloud bitstream; filling the point cloud bitstreams with quality indication information for representing the point cloud quality according to the encoding standards; encapsulating the point cloud bitstreams into a point cloud media track, and filling the point cloud media track with quality indication information corresponding to the point cloud bitstreams.

[0014] According to one aspect of the embodiments of this application, a point cloud encoding apparatus is provided. The apparatus includes: an encoding module configured to encode point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams with the same point cloud content but different point cloud qualities, wherein the point cloud quality includes at least one of the bit rate and frame rate of the point cloud bitstream; a filling module configured to fill the point cloud bitstreams with quality indication information representing the point cloud quality according to the encoding standards; and an encapsulation module configured to encapsulate the point cloud bitstreams into a point cloud media track and fill the point cloud media track with quality indication information corresponding to the point cloud bitstreams.

[0015] In some embodiments of this application, based on the above technical solutions, the point cloud encoding device further includes: a signaling generation module configured to generate streaming media signaling for transmitting point cloud data; a signaling filling module configured to fill the streaming media signaling with quality indication information corresponding to each of the point cloud bitstreams; and a signaling sending module configured to send the streaming media signaling to the data receiver.

[0016] In some embodiments of this application, based on the above technical solutions, the point cloud encoding device further includes: a request receiving module configured to receive a data transmission request generated based on the streaming media signaling sent by the data receiver; and a file transmission module configured to transmit a point cloud file to the data receiver according to the data transmission request, wherein the point cloud file includes point cloud media tracks having the same point cloud content but different point cloud qualities.

[0017] In some embodiments of this application, based on the above technical solutions, the filling module includes: a value determination unit, configured to determine the parameter values ​​of the quality parameters of the point cloud code stream according to the encoding standard, and determine a quality indication field corresponding to the quality parameters in the point cloud code stream; a first information determination unit, configured to determine quality indication information for representing the quality of the point cloud according to the parameter values ​​of the quality parameters; and a first information filling unit, configured to fill the quality indication information into the quality indication field according to the correspondence between the quality parameters and the quality indication field.

[0018] In some embodiments of this application, based on the above technical solutions, the encapsulation module includes:

[0019] The second information determination unit is configured to determine a quality indicator field corresponding to the quality indicator information in the file encapsulation information of the point cloud media track.

[0020] The second information filling unit is configured to fill the quality indicator field in the file encapsulation information with quality indicator information corresponding to the point cloud code stream.

[0021] According to one aspect of the embodiments of this application, a computer-readable medium is provided having a computer program stored thereon, which, when executed by a processor, implements the methods described in the above technical solutions.

[0022] According to one aspect of the embodiments of this application, an electronic device is provided, the electronic device comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the method as described in the above technical solutions by executing the executable instructions.

[0023] According to one aspect of the embodiments of this application, a computer program product or computer program is provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method as described in the above technical solutions.

[0024] In the technical solution provided in this application embodiment, by adding quality indication information to represent point cloud quality during point cloud data encoding and file encapsulation, the quality level of point cloud files and each component (geometry, attributes, etc.) can be clearly indicated, enabling clients to request the corresponding point cloud files more accurately and select the corresponding components according to the client's own needs and performance conditions during decoding and presentation.

[0025] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0026] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. It is obvious that the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0027] Figure 1 A schematic diagram of an exemplary system architecture to which the technical solutions of the embodiments of this application can be applied is shown.

[0028] Figure 2 This illustrates the placement of the point cloud encoding device and the point cloud decoding device in a streaming environment.

[0029] Figure 3 A flowchart illustrating the steps of a point cloud decoding method in one embodiment of this application is shown.

[0030] Figure 4 A schematic diagram of a replaceable assembly packaged in a multi-track configuration is shown in one embodiment of this application.

[0031] Figure 5 A flowchart illustrating the steps of receiving a point cloud file from a data source in one embodiment of this application is shown.

[0032] Figure 6 A flowchart illustrating the steps of a point cloud encoding method in one embodiment of this application is shown.

[0033] Figure 7 A schematic diagram of the high-level syntax of the GPCC code stream in one embodiment of this application is shown.

[0034] Figure 8 A flowchart illustrating the steps of point cloud data transmission using bit rate as quality indicator information in one embodiment of this application is shown.

[0035] Figure 9 A flowchart illustrating the steps of point cloud data transmission using frame rate as quality indicator information in one embodiment of this application is shown.

[0036] Figure 10 A schematic block diagram of the point cloud decoding device provided in an embodiment of this application is shown.

[0037] Figure 11 A schematic block diagram of the point cloud encoding device provided in an embodiment of this application is shown.

[0038] Figure 12 A schematic diagram of a computer system architecture suitable for implementing the embodiments of this application is shown. Detailed Implementation

[0039] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided to make this application more comprehensive and complete, and to fully convey the concept of the exemplary embodiments to those skilled in the art.

[0040] Furthermore, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Numerous specific details are provided in the following description to give a thorough understanding of embodiments of this application. However, those skilled in the art will recognize that the technical solutions of this application can be practiced without one or more of the specific details, or other methods, components, apparatuses, steps, etc., can be employed. In other instances, well-known methods, apparatuses, implementations, or operations are not shown or described in detail to avoid obscuring various aspects of this application.

[0041] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0042] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0043] A point cloud is a set of randomly distributed discrete points in space that represent the spatial structure and surface properties of a three-dimensional object or scene. Each point in a point cloud has at least three-dimensional position information and may also have color, material, or other information depending on the application scenario. Typically, each point in a point cloud has the same number of additional attributes. Point cloud media can be further divided into video-based point cloud compression (VPCC) and geometry-based point cloud compression (GPCC) based on encoding methods. In the file encapsulation of point cloud media, the three-dimensional position information is usually called the geometry component of the point cloud file, and the attribute information is called the attribute component. A point cloud file has only one geometry component, but it can have one or more attribute components.

[0044] Point clouds can flexibly and conveniently represent the spatial structure and surface attributes of three-dimensional objects or scenes, and therefore have a wide range of applications. Their main applications can be categorized into two main types: 1) Machine-perceived point clouds, such as autonomous navigation systems, real-time inspection systems, geographic information systems, visual sorting robots, and disaster relief robots. 2) Human-perceived point clouds, such as digital cultural heritage, free-viewpoint broadcasting, 3D immersive communication, and 3D immersive interaction.

[0045] Point clouds are primarily acquired through the following methods: computer generation, 3D laser scanning, and 3D photogrammetry. Computers can generate point clouds of virtual 3D objects and scenes. 3D scanning can obtain point clouds of static real-world 3D objects or scenes, acquiring millions of point clouds per second. 3D photography can obtain point clouds of dynamic real-world 3D objects or scenes, acquiring tens of millions of point clouds per second. Furthermore, in the medical field, point clouds of biological tissues and organs can be obtained from MRI, CT, and electromagnetic positioning information. These technologies have reduced the cost and time required for point cloud data acquisition and improved data accuracy. This transformation in point cloud data acquisition methods has made the acquisition of massive amounts of point cloud data possible. With the continuous accumulation of large-scale point cloud data, efficient storage, transmission, publication, sharing, and standardization of point cloud data have become crucial for point cloud applications.

[0046] After encoding point cloud media, the encoded data stream needs to be encapsulated and transmitted to the user. Correspondingly, on the point cloud media player, the point cloud file needs to be decapsulated first, then decoded, and finally the decoded data stream is presented.

[0047] Figure 1A schematic diagram of an exemplary system architecture to which the technical solutions of the embodiments of this application can be applied is shown.

[0048] like Figure 1 As shown, system architecture 100 includes multiple terminal devices that can communicate with each other via, for example, a network 150. For instance, system architecture 100 may include a first terminal device 110 and a second terminal device 120 interconnected via network 150. Figure 1 In one embodiment, the first terminal device 110 and the second terminal device 120 perform unidirectional data transmission.

[0049] For example, the first terminal device 110 can encode point cloud data (e.g., point cloud bitstreams collected by the first terminal device 110) to transmit it to the second terminal device 120 via the network 150. The encoded point cloud data is transmitted in the form of one or more encoded point cloud bitstreams. The second terminal device 120 can receive the encoded point cloud data from the network 150, decode the encoded point cloud data, and display the decoded point cloud data.

[0050] In one embodiment of this application, system architecture 100 may include a third terminal device 130 and a fourth terminal device 140 that perform bidirectional transmission of encoded point cloud data, such as during a video conference. For bidirectional data transmission, each of the third terminal device 130 and the fourth terminal device 140 may encode point cloud data (e.g., a point cloud bitstream acquired by the terminal device) for transmission over network 150 to the other terminal device. Each of the third terminal device 130 and the fourth terminal device 140 may also receive encoded point cloud data transmitted by the other terminal device, decode the encoded point cloud data to recover the point cloud data, and display the recovered point cloud data on an accessible display device.

[0051] exist Figure 1In the embodiments disclosed herein, the first terminal device 110, the second terminal device 120, the third terminal device 130, and the fourth terminal device 140 may be servers, personal computers, and smartphones, but the principles disclosed herein are not limited to these. The embodiments disclosed herein are applicable to laptop computers, tablet computers, media players, and / or dedicated video conferencing equipment. Network 150 refers to any number of networks, including, for example, wired and / or wireless communication networks, that transmit encoded point cloud data between the first terminal device 110, the second terminal device 120, the third terminal device 130, and the fourth terminal device 140. Network 150 may exchange data in circuit-switched and / or packet-switched channels. This network may include telecommunications networks, local area networks, wide area networks, and / or the Internet. For the purposes of this application, unless explained below, the architecture and topology of network 150 may be irrelevant to the operation of this application.

[0052] In one embodiment of this application, Figure 2 The diagram illustrates the placement of a point cloud encoding device and a point cloud decoding device in a streaming environment. The subject matter disclosed in this application is equally applicable to other point cloud-supporting applications, including, for example, video conferencing, digital television, and storing compressed point cloud data on digital media including CDs, DVDs, memory sticks, etc.

[0053] The streaming system may include an acquisition subsystem 213, which may include a point cloud data source 201 such as a digital camera. The point cloud data source 201 may, for example, create uncompressed point cloud data 202. In an embodiment, the point cloud data 202 includes samples captured by a digital camera. Compared to encoded point cloud data 204 (or encoded point cloud stream), the point cloud data 202 is depicted as thick lines to emphasize the high data volume of the point cloud data. The point cloud data 202 may be processed by an electronic device 220, which includes a video encoding device 203 coupled to the point cloud data source 201. The video encoding device 203 may include hardware, software, or a combination of hardware and software to implement or carry out aspects of the disclosed subject matter as described in more detail below. Compared to point cloud data 202, encoded point cloud data 204 (or encoded point cloud bitstream) is depicted as thin lines to emphasize the lower data volume of encoded point cloud data 204 (or encoded point cloud bitstream), which can be stored on streaming server 205 for future use. One or more streaming client subsystems, such as... Figure 2Client subsystems 206 and 208 can access streaming server 205 to retrieve encoded point cloud data 207 and 209 as copies of point cloud data 204. Client subsystem 206 may include, for example, a point cloud decoding device 210 in electronic device 230. Point cloud decoding device 210 decodes the incoming copy 207 of the encoded point cloud data and produces output point cloud data 211 that can be presented on display 212 (e.g., a display screen) or another presentation device. In some streaming systems, the encoded point cloud data 204, point cloud data 207, and point cloud data 209 (e.g., point cloud streams) may be encoded according to certain point cloud encoding / compression standards. Embodiments of these standards may include standards developed by MPEG for GPCC.

[0054] It should be noted that electronic devices 220 and 230 may include other components not shown in the figures. For example, electronic device 220 may include a point cloud decoding device, and electronic device 230 may also include a point cloud encoding device.

[0055] The technical solutions provided in this application, including point cloud encoding / decoding methods, point cloud encoding / decoding devices, computer-readable media, and electronic devices, are described in detail below with reference to specific embodiments.

[0056] Figure 3 This document illustrates a flowchart of a point cloud decoding method according to one embodiment of this application. This method can be applied to servers, clients, and intermediate nodes in a point cloud media system. This embodiment uses a point cloud decoding method executed by a client device equipped with a point cloud decoding device as an example. Figure 3 As shown, the point cloud decoding method mainly includes the following steps S310 to S330.

[0057] Step S310: Receive point cloud files transmitted from the data source. The point cloud files include point cloud media tracks with the same point cloud content but different point cloud qualities.

[0058] Point cloud files contain alternative groups corresponding to different point cloud media tracks. Point cloud media tracks with the same point cloud content but different point cloud qualities can be grouped into the same alternative group. When GPCC point cloud data is encapsulated as a single track, tracks with point cloud content of different qualities belong to the same alternative group. When GPCC point cloud data is encapsulated as multiple tracks, geometric component tracks with point cloud content of different qualities belong to the same alternative group, while attribute component tracks can be associated with geometric component tracks.

[0059] Figure 4 A schematic diagram of a replaceable assembly packaged in a multi-track configuration according to one embodiment of this application is shown. Figure 4As shown, the replaceable group 400 includes a first point cloud data 410 and a second point cloud data 420 with the same point cloud content. The first point cloud data 410 is lossless compressed point cloud data (Losslesscoded GPCC) with relatively high point cloud quality, and the second point cloud data 420 is lossy compressed point cloud data (Lossycoded GPCC) with relatively low point cloud quality.

[0060] The first point cloud data 410 includes a first geometric component orbital 411 and a first attribute component orbital 412 associated with the first geometric component orbital 411, and the second point cloud data 420 includes a second geometric component orbital 421 and a second attribute component orbital 422 associated with the second geometric component orbital 421.

[0061] Step S320: Parse the file encapsulation information of the point cloud media track to obtain the quality indication information carried in the file encapsulation information. The quality indication information is used to indicate the point cloud quality of the point cloud media track.

[0062] File encapsulation information is a data box generated when encapsulating a point cloud bitstream into a point cloud file. It is used to record decoding configuration data related to the point cloud file. For example, it can be a GPCC decoder configuration record data box (GPCCDecoderConfigurationRecord).

[0063] In one embodiment of this application, the method for parsing file encapsulation information to obtain quality indication information may include: parsing the file encapsulation information of a point cloud media track to determine at least one quality indication field related to the quality parameters of the point cloud media track; and determining the quality indication information of the point cloud media file based on the value of the quality indication field.

[0064] In one embodiment of this application, the quality parameters of the point cloud media track may include at least one of the bitrate and frame rate of the point cloud bitstream. In some other optional embodiments, the quality parameters may also include other media resource quality-related parameters such as resolution and image quality.

[0065] In one embodiment of this application, the quality indication information includes at least one of the following: the true quality value, the equivalent quality value, and the quality grade.

[0066] The true quality value is the value of the quality parameter. For example, if a point cloud media track corresponds to a point cloud stream with a bitrate of 10000 bits / s, then the true quality value of 10000 can be determined as the quality indication information for that point cloud media track. As another example, if a point cloud media track corresponds to a point cloud stream with a frame rate of 30 frames per second, then the true quality value of 30 can be determined as the quality indication information for that point cloud media track.

[0067] The quality equivalent value is the number of unit quality parameters obtained by comparing the value of a quality parameter with a preset unit quality parameter. For example, if 400 bit / s is used as the unit quality parameter, and the bit rate of the point cloud bit cloud stream corresponding to a point cloud media track is 10000 bit / s, then the quality equivalent value 10000 / 400 = 25 can be used as the quality indication information. When the ratio between the value of a quality parameter and the preset unit quality parameter is a decimal, the ratio can be rounded up to determine the number of unit quality parameters.

[0068] Quality level is a graded information used to represent the range of values ​​for a quality parameter. For example, for the parameter bitrate, multiple different bitrate value ranges can be preset, and each bitrate value range corresponds to a bitrate level. This bitrate level is the quality level used to represent the point cloud quality.

[0069] In one embodiment of this application, the syntax for configuring the record data box as file encapsulation information in the GPCC decoder is as follows.

[0070]

[0071]

[0072] Here, bitrate is the quality indicator field corresponding to bitrate, and its value is an unsigned integer of length 8 bytes; frame_rate is the quality indicator field corresponding to frame rate, and its value is also an unsigned integer of length 8 bytes.

[0073] Step S330: Select and decode a point cloud media track with the specified point cloud quality from the point cloud file according to the quality indication information carried in the file encapsulation information.

[0074] Each point cloud media track's corresponding file encapsulation information carries quality indication information for that track, explicitly identifying the point cloud quality. When the point cloud file is transmitted from the data source to the user's data receiver, the receiver can decode the point cloud media track with the specified quality based on device performance and user requirements.

[0075] In one embodiment of this application, the device performance of the data receiver can be collected, and the device performance can be matched and detected with the quality indication information carried in the file encapsulation information to determine the point cloud quality that matches the device performance of the data receiver. Then, a point cloud media track with the specified point cloud quality can be selected and decoded from the point cloud file.

[0076] Device performance can include at least one of hardware performance, software performance, and network performance. Hardware performance may include, for example, the device model, processor model, memory capacity, display size, etc. Software performance may include, for example, the program version of the point cloud decoder installed on the data receiver, and network performance may include, for example, network bandwidth, network transmission status, etc.

[0077] In one embodiment of this application, the quality selection rules configured by the data receiver can be obtained, and the quality selection rules can be matched and detected with the quality indication information carried in the file encapsulation information to determine the point cloud quality that matches the quality selection rules configured by the data receiver. Then, a point cloud media track with the specified point cloud quality can be selected and decoded from the point cloud file.

[0078] The quality selection rule can be a selection rule configured according to user needs to select point cloud data with a specified point cloud quality. For example, it can select point cloud data with a bit rate greater than (or less than) a specified value according to user instructions.

[0079] Figure 5 A flowchart illustrating the steps of receiving a point cloud file from a data source in one embodiment of this application is shown. Figure 5 As shown, based on the above embodiments, receiving the point cloud file transmitted by the data source in step S310 may include the following steps S510 to S540.

[0080] Step S510: Receive streaming media signaling sent by the data source for transmitting point cloud data.

[0081] In one embodiment of this application, the streaming media signaling used to transmit point cloud data can be dynamic adaptive streaming over HTTP (DASH) signaling, which is an adaptive bitrate streaming technology that enables high-quality streaming media to be transmitted over the Internet through a traditional HTTP web server.

[0082] Step S520: Parse the streaming media signaling to obtain at least two selectable quality indication information carried in the streaming media signaling.

[0083] In DASH signaling, existing fields can be used to store selectable quality indication information. For example, the bandwidth field in DASH signaling can be used to indicate the bitrate of various point cloud media tracks, and the frameRate field in DASH signaling can be used to indicate the frame rate of various point cloud media tracks.

[0084] Step S530: Send a data transmission request to the data source according to the quality indication information carried in the streaming media signaling.

[0085] Based on the quality indication information carried in the parsed streaming media signaling, one or more quality indication information can be selected as the target point cloud quality, and a data transmission request corresponding to the target point cloud quality can be sent to the data source.

[0086] In one embodiment of this application, the method of sending a data transmission request may include: obtaining the network bandwidth for data transmission with the data source; matching and detecting the network bandwidth with the quality indication information carried in the streaming media signaling to select a target point cloud quality that matches the network bandwidth; and sending a data transmission request generated based on the target point cloud quality to the data source.

[0087] In one embodiment of this application, when the network bandwidth is greater than a set threshold, two or more target point cloud qualities can be selected. When the network bandwidth is less than or equal to the set threshold, only one target point cloud quality can be selected.

[0088] Step S540: Receive the point cloud file corresponding to the data transmission request transmitted by the data source.

[0089] When a data transmission request corresponding to a target point cloud quality is sent to a data source based on quality indication information, the data source can transmit a corresponding point cloud media track to the data receiver based on the request. When multiple data transmission requests corresponding to target point cloud qualities are sent to a data source based on quality indication information, the data source can transmit multiple point cloud media tracks with different point cloud qualities to the data receiver based on the requests.

[0090] Figure 6 A flowchart illustrating the steps of a point cloud encoding method in one embodiment of this application is shown. This point cloud encoding method can be applied to the server, client, and intermediate nodes of a point cloud media system. This embodiment uses a point cloud encoding method executed by a server device equipped with a point cloud encoding device as an example. Figure 6 As shown, the point cloud encoding method mainly includes the following steps S610 to S630.

[0091] Step S610: Encode the point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams with the same point cloud content but different point cloud quality.

[0092] To meet the different quality requirements of point cloud data for various data receivers, point cloud data of a specific point cloud content can be encoded using multiple different encoding standards to obtain point cloud bitstreams with varying point cloud qualities. Encoding standards can include one or more quality parameter values. Combining different values ​​of various quality parameters can form multiple different encoding standards. For example, when quality parameters include bitrate and frame rate, and bitrate includes two different bitrate values ​​A1 and A2, and frame rate also includes two different frame rate values ​​B1 and B2, four encoding standards corresponding to different quality parameter values ​​can be determined: A1B1, A1B2, A2B1, and A2B2.

[0093] Step S620: Fill the point cloud code stream with quality indication information to represent the quality of the point cloud according to the encoding standard.

[0094] In one embodiment of this application, a method for filling a point cloud code stream with quality indication information may include: determining the parameter values ​​of the quality parameters of the point cloud code stream according to an encoding standard, and determining a quality indication field in the point cloud code stream corresponding to the quality parameters; determining quality indication information for representing the point cloud quality according to the parameter values ​​of the quality parameters; and filling the quality indication information into the quality indication field according to the correspondence between the quality parameters and the quality indication field.

[0095] Figure 7 A schematic diagram of the high-level syntax of the GPCC code stream in one embodiment of this application is shown. Figure 7 As shown, the sequence parameter set syntax of the point cloud data bitstream has multiple quality indicator fields corresponding to the quality parameters. Among them, the bitrate field is the quality indicator field corresponding to the bitrate, and its value is an unsigned integer of length 32 bytes; the frame_rate field is the quality indicator field corresponding to the frame rate, and its value is an unsigned integer of length 8 bytes.

[0096] In one embodiment of this application, the quality parameters of the point cloud bitstream may include at least one of bitrate and frame rate. In some other optional embodiments, the quality parameters may also include other parameters related to the quality of the media resource, such as resolution and image quality.

[0097] In one embodiment of this application, the quality indication information includes at least one of the following: the true quality value, the equivalent quality value, and the quality grade.

[0098] The true quality value is the parameter value of the quality parameter. For example, if the bitrate of a point cloud stream is 10000 bits / s, then the true quality value of 10000 can be determined as the quality indicator information for that point cloud stream. As another example, if the frame rate of a point cloud stream is 30 frames per second, then the true quality value of 30 can be determined as the quality indicator information for that point cloud stream.

[0099] The quality equivalent value is the number of unit quality parameters obtained by comparing the value of a quality parameter with a preset unit quality parameter. For example, if 400 bits / s is used as the unit quality parameter and the bitrate of a point cloud bitstream is 10000 bits / s, then the quality equivalent value 10000 / 400 = 25 can be used as the quality indication information. When the ratio between the value of a quality parameter and the preset unit quality parameter is a decimal, the ratio can be rounded up to determine the number of unit quality parameters.

[0100] Quality level is a graded information used to represent the range of values ​​for a quality parameter. For example, for the parameter bitrate, multiple different bitrate value ranges can be preset, and each bitrate value range corresponds to a bitrate level. This bitrate level is the quality level used to represent the point cloud quality.

[0101] Step S630: Encapsulate the point cloud bitstream into a point cloud media track, and fill the point cloud media track with quality indication information corresponding to the point cloud bitstream.

[0102] Each point cloud media track has corresponding file encapsulation information. This encapsulation information can be, for example, a data box generated when encapsulating the point cloud bitstream into a point cloud file to record decoding configuration data related to the point cloud file, such as a GPCC decoder configuration record data box (GPCCDecoderConfigurationRecord). After determining the quality indicator field corresponding to the quality indicator information in the file encapsulation information of the point cloud media track, the quality indicator information corresponding to the point cloud bitstream can be filled into the quality indicator field in the file encapsulation information by referencing the instruction indicator information of the point cloud bitstream.

[0103] In one embodiment of this application, after encapsulating the point cloud bitstream into a point cloud media track, streaming media signaling for transmitting point cloud data can be generated according to data transmission requirements; this streaming media signaling can be the DASH signaling described in the above embodiments. Quality indication information corresponding to each point cloud bitstream is filled into the streaming media signaling. The filling method can be to numerically fill existing fields in the DASH signaling based on the quality parameter information of the point cloud media track. Then, the streaming media signaling is sent to the data receiver to enable point cloud data transmission between the data source and the data receiver.

[0104] In one embodiment of this application, after the data receiver responds to the streaming media signaling, the data source can receive the data transmission request generated by the streaming media signaling sent by the data receiver; according to the data transmission request, a point cloud file is transmitted to the data receiver, the point cloud file including point cloud media tracks with the same point cloud content but different point cloud qualities.

[0105] Figure 8 A flowchart illustrating the steps of point cloud data transmission using bit rate as a quality indicator in one embodiment of this application is shown. Figure 8 As shown, the server acts as the data source for producing point cloud data. The method for transmitting point cloud data between the server and the user's client can include the following steps.

[0106] Step S801: Encode the point cloud content A on the server to obtain point cloud bitstreams S1 and S2 corresponding to two different bitrates. Fill the bitrate field in each bitstream according to the actual bitstream. For example, in point cloud bitstream S1, fill in bitrate=10000; in point cloud bitstream S2, fill in bitrate=20000.

[0107] Step S802: Encapsulate S1 and S2 into two different point cloud media tracks T1 and T2 respectively, and fill the bitrate field of the GPCCDecoderConfigurationRecord data box in T1 and T2 accordingly. For example, in the GPCCDecoderConfigurationRecord data box of point cloud media track T1, fill bitrate=10000; in the GPCCDecoderConfigurationRecord data box of point cloud media track T2, fill bitrate=20000.

[0108] Step S803: Use the bandwidth field in the DASH signaling to indicate the bit rate of T1 and T2, and send the DASH signaling to the client C1 and C2 where the user is located, respectively.

[0109] Step S804: Clients C1 and C2 request point cloud files based on network bandwidth and information in the DASH signaling. The files contain T1 and T2.

[0110] Step S805: The server transmits point cloud files to clients C1 and C2 respectively.

[0111] Step S806: The client receives the point cloud file, selects the point cloud media track in the decoder group based on the bitrate field information in T1 and T2 and its own device capabilities, and presents the decoded point cloud data. For example, C1 selects and presents the T1 media file in the decoder group; C2 selects and presents the T2 media file in the decoder group.

[0112] In this embodiment of the application, the point cloud file requested by the user contains all resources in the replaceable group. After receiving the point cloud file, the transmitted point cloud data can be selectively decoded.

[0113] Figure 9 A flowchart illustrating the steps of point cloud data transmission using frame rate as a quality indicator in one embodiment of this application is shown. Figure 9 As shown, the server acts as the data source for producing point cloud data. The method for transmitting point cloud data between the server and the user's client can include the following steps.

[0114] Step S901: Encode the point cloud content A on the server to obtain point cloud bitstreams S1 and S2 corresponding to two different bitrates. Fill the frame_rate field in each bitstream according to the actual bitstream. For example, in point cloud bitstream S1, fill in frame_rate = 30; in point cloud bitstream S2, fill in frame_rate = 60.

[0115] Step S902: Encapsulate S1 and S2 into two different point cloud media tracks T1 and T2 respectively, and fill the frame_rate field of the GPCCDecoderConfigurationRecord data box in T1 and T2 accordingly. For example, in the GPCCDecoderConfigurationRecord data box of point cloud media track T1, fill frame_rate = 30; in the GPCCDecoderConfigurationRecord data box of point cloud media track T2, fill frame_rate = 60.

[0116] Step S903: Use the existing frameRate field in the DASH signaling to indicate the frame rates of T1 and T2, and send the DASH signaling to the client C1 and C2 where the user is located, respectively.

[0117] Step S904: Clients C1 and C2 request point cloud files based on network bandwidth and information from the DASH signaling. C1 requests a file containing both T1 and T2; C2 requests a file containing only T1.

[0118] Step S905: The server transmits point cloud files to clients C1 and C2 respectively.

[0119] Step S906: The client receives the point cloud file, selects the point cloud media track in the replaceable group for decoding based on the frameRate field information in T1 and T2 and its own device capabilities, and presents the decoded point cloud data. For example, C1 selects to decode and present the T2 media file in the replaceable group; C2 decodes and presents the T1 media file in the replaceable group.

[0120] In this embodiment of the application, the point cloud file requested by the user may contain only some resources within the replaceable group in order to save network bandwidth.

[0121] In the technical solution provided in this application embodiment, by adding several descriptive fields at the system layer, including field extensions at the bitstream level and file encapsulation level, the quality level of the point cloud file and each component (geometry, attributes, etc.) can be more clearly indicated, enabling the client to request the corresponding point cloud file more accurately, and to select the corresponding component according to the client's own needs and performance conditions during decoding and rendering.

[0122] It should be noted that although the steps of the method in this application are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and / or one step may be broken down into multiple steps.

[0123] The following describes an apparatus embodiment of this application, which can be used to execute the point cloud encoding and decoding method in the above embodiments of this application.

[0124] Figure 10 A schematic block diagram of the point cloud decoding device provided in an embodiment of this application is shown. Figure 10 As shown, the point cloud decoding device 1000 may include: a receiving module 1010 configured to receive a point cloud file transmitted by a data source, the point cloud file including point cloud media tracks having the same point cloud content but different point cloud qualities; a parsing module 1020 configured to parse the file encapsulation information of the point cloud media tracks to obtain quality indication information carried in the file encapsulation information, the quality indication information being used to indicate the point cloud quality of the point cloud media tracks; and a decoding module 1030 configured to select and decode a point cloud media track with a specified point cloud quality from the point cloud file according to the quality indication information carried in the file encapsulation information.

[0125] In some embodiments of this application, based on the above technical solutions, the receiving module 1010 includes: a signaling receiving unit configured to receive streaming media signaling sent by a data source for transmitting point cloud data; a signaling parsing unit configured to parse the streaming media signaling to obtain at least two selectable quality indication information carried in the streaming media signaling; a request sending unit configured to send a data transmission request to the data source according to the quality indication information carried in the streaming media signaling; and a file receiving unit configured to receive a point cloud file transmitted by the data source corresponding to the data transmission request.

[0126] In some embodiments of this application, based on the above technical solutions, the request sending unit includes: a bandwidth acquisition subunit configured to acquire the network bandwidth for data transmission with the data source; a bandwidth matching subunit configured to match and detect the network bandwidth with the quality indication information carried in the streaming media signaling to select a target point cloud quality that matches the network bandwidth; and a request sending subunit configured to send a data transmission request generated based on the target point cloud quality to the data source.

[0127] In some embodiments of this application, based on the above technical solutions, the parsing module 1020 includes: an information parsing unit configured to parse the file encapsulation information of the point cloud media track to determine at least one quality indicator field related to the quality parameters of the point cloud media track; and an information determining unit configured to determine the quality indicator information of the point cloud media file based on the value of the quality indicator field.

[0128] In some embodiments of this application, based on the above technical solutions, the quality indication information includes at least one of the following: true quality value, equivalent quality value, and quality grade; wherein, the true quality value is the parameter value of the quality parameter, the equivalent quality value is the quantity of unit quality parameters obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter, and the quality grade is grade information used to represent the range of parameter values ​​of the quality parameter.

[0129] In some embodiments of this application, based on the above technical solutions, the quality parameters include at least one of the bitrate and frame rate of the point cloud bitstream.

[0130] Figure 11 A schematic block diagram of the point cloud encoding device provided in an embodiment of this application is shown. Figure 11As shown, the point cloud encoding device 1100 may include: an encoding module 1110, configured to encode the point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams with the same point cloud content but different point cloud qualities; a filling module 1120, configured to fill the point cloud bitstream with quality indication information representing the point cloud quality according to the encoding standard; and an encapsulation module 1130, configured to encapsulate the point cloud bitstream into a point cloud media track and fill the point cloud media track with quality indication information corresponding to the point cloud bitstream.

[0131] In some embodiments of this application, based on the above technical solutions, the point cloud encoding device 1100 further includes: a signaling generation module configured to generate streaming media signaling for transmitting point cloud data; a signaling filling module configured to fill the streaming media signaling with quality indication information corresponding to each of the point cloud bitstreams; and a signaling sending module configured to send the streaming media signaling to the data receiver.

[0132] In some embodiments of this application, based on the above technical solutions, the point cloud encoding device 1100 further includes: a request receiving module configured to receive a data transmission request generated based on the streaming media signaling sent by the data receiver; and a file transmission module configured to transmit a point cloud file to the data receiver according to the data transmission request, wherein the point cloud file includes point cloud media tracks having the same point cloud content but different point cloud qualities.

[0133] In some embodiments of this application, based on the above technical solutions, the filling module 1120 includes: a value determination unit, configured to determine the parameter values ​​of the quality parameters of the point cloud code stream according to the encoding standard, and determine a quality indication field corresponding to the quality parameters in the point cloud code stream; a first information determination unit, configured to determine quality indication information for representing the quality of the point cloud according to the parameter values ​​of the quality parameters; and a first information filling unit, configured to fill the quality indication information into the quality indication field according to the correspondence between the quality parameters and the quality indication field.

[0134] In some embodiments of this application, based on the above technical solutions, the encapsulation module 1130 includes: a second information determination unit, configured to determine a quality indicator field corresponding to the quality indicator information in the file encapsulation information of the point cloud media track; and a second information filling unit, configured to fill the quality indicator information corresponding to the point cloud bitstream into the quality indicator field in the file encapsulation information.

[0135] The specific details of the point cloud encoding and decoding apparatus provided in the various embodiments of this application have been described in detail in the corresponding method embodiments, and will not be repeated here.

[0136] Figure 12 A schematic block diagram of a computer system architecture for implementing an electronic device according to embodiments of the present application is shown.

[0137] It should be noted that, Figure 12 The computer system 1200 of the electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0138] like Figure 12 As shown, the computer system 1200 includes a central processing unit (CPU) 1201, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 1202 or programs loaded from storage section 1208 into random access memory (RAM). The RAM 1203 also stores various programs and data required for system operation. The CPU 1201, ROM 1202, and RAM 1203 are interconnected via a bus 1204. An input / output interface 1205 (I / O interface) is also connected to the bus 1204.

[0139] The following components are connected to the input / output interface 1205: an input section 1206 including a keyboard, mouse, etc.; an output section 1207 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 1208 including a hard disk, etc.; and a communication section 1209 including a network interface card such as a local area network card, modem, etc. The communication section 1209 performs communication processing via a network such as the Internet. A drive 1210 is also connected to the input / output interface 1205 as needed. A removable medium 1211, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 1210 as needed so that computer programs read from it can be installed into the storage section 1208 as needed.

[0140] Specifically, according to embodiments of this application, the processes described in the various method flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 1209, and / or installed from removable medium 1211. When the computer program is executed by central processing unit 1201, it performs various functions defined in the system of this application.

[0141] It should be noted that the computer-readable medium shown in the embodiments of this application can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this application, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such transmitted data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, etc., or any suitable combination thereof.

[0142] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0143] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiments of this application, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0144] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, touch terminal, or network device, etc.) to execute the method according to the embodiments of this application.

[0145] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein.

[0146] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A point cloud decoding method, characterized in that, include: The system receives point cloud files transmitted from a data source. The point cloud files encapsulate replaceable groups corresponding to different point cloud media tracks. Point cloud media tracks with the same point cloud content but different point cloud quality are classified into the same replaceable group. When the point cloud data is encapsulated as a single track, the tracks of point cloud content with different quality belong to the same replaceable group. When the point cloud data is encapsulated as a multi-track, the geometric component tracks of point cloud content with different quality belong to the same replaceable group, and the attribute component tracks of the point cloud content are associated with the geometric component tracks. The file encapsulation information of the point cloud media track is parsed to obtain the quality indication information carried in the file encapsulation information. The quality indication information is used to represent the point cloud quality of the point cloud media track. The point cloud quality includes at least one of the bit rate and frame rate of the point cloud bitstream. Based on the quality indication information carried in the file encapsulation information, a point cloud media track with a specified point cloud quality is selected and decoded from the point cloud file.

2. The point cloud decoding method according to claim 1, characterized in that, Receive point cloud files transmitted from the data source, including: Receive streaming media signaling sent by the data source for transmitting point cloud data; Parse the streaming media signaling to obtain at least two selectable quality indication information carried in the streaming media signaling; Based on the quality indication information carried in the streaming media signaling, a data transmission request is sent to the data source; Receive the point cloud file corresponding to the data transmission request transmitted by the data source.

3. The point cloud decoding method according to claim 2, characterized in that, Based on the quality indication information carried in the streaming media signaling, a data transmission request is sent to the data source, including: Obtain the network bandwidth for data transmission with the data source; The network bandwidth is matched and detected with the quality indication information carried in the streaming media signaling to select the target point cloud quality that matches the network bandwidth; Send a data transmission request generated based on the quality of the target point cloud to the data source.

4. The point cloud decoding method according to any one of claims 1 to 3, characterized in that, Parse the file encapsulation information of the point cloud media track to obtain the quality indication information carried in the file encapsulation information, including: Parse the file encapsulation information of the point cloud media track to determine at least one quality indicator field related to the quality parameters of the point cloud media track; The quality indication information of the point cloud media track is determined based on the value of the quality indication field.

5. The point cloud decoding method according to claim 4, characterized in that, The quality indication information includes at least one of the following: true quality value, equivalent quality value, and quality grade; wherein, the true quality value is the parameter value of the quality parameter, the equivalent quality value is the quantity of unit quality parameters obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter, and the quality grade is grade information used to represent the range of parameter values ​​of the quality parameter.

6. A point cloud encoding method, characterized in that, include: The point cloud data to be transmitted is encoded according to different encoding standards to obtain point cloud bitstreams with the same point cloud content but different point cloud quality. The point cloud quality includes at least one of the bit rate and frame rate of the point cloud bitstream. According to the encoding standard, quality indication information for representing the quality of the point cloud is filled into the point cloud code stream; The point cloud stream is encapsulated into a point cloud media track within a point cloud file, and quality indication information corresponding to the point cloud stream is filled into the point cloud media track. The point cloud file encapsulates replaceable groups corresponding to different point cloud media tracks. Point cloud media tracks with the same point cloud content but different point cloud qualities are grouped into the same replaceable group. When point cloud data is encapsulated as a single track, tracks of point cloud content with different qualities belong to the same replaceable group. When point cloud data is encapsulated as multiple tracks, geometric component tracks of point cloud content with different qualities belong to the same replaceable group, and attribute component tracks of point cloud content are associated with geometric component tracks.

7. The point cloud encoding method according to claim 6, characterized in that, After encapsulating the point cloud bitstream into a point cloud media track within a point cloud file, the method further includes: Generate streaming media signaling for transmitting point cloud data; Fill the streaming media signaling with quality indication information corresponding to each of the point cloud bitstreams; Send the streaming media signaling to the data receiver.

8. The point cloud encoding method according to claim 7, characterized in that, After sending the streaming media signaling to the data receiver, the method further includes: Receive a data transmission request generated based on the streaming media signaling sent by the data receiver; The point cloud file is transmitted to the data receiver according to the data transmission request.

9. The point cloud encoding method according to any one of claims 6 to 8, characterized in that, According to the encoding standard, quality indication information representing the quality of the point cloud is filled into the point cloud bitstream, including: The parameter values ​​of the quality parameters of the point cloud bitstream are determined according to the encoding standard, and a quality indicator field corresponding to the quality parameters is determined in the point cloud bitstream. Based on the parameter values ​​of the quality parameters, quality indication information used to represent the point cloud quality is determined; Based on the correspondence between the quality parameters and the quality indicator field, the quality indicator information is filled into the quality indicator field.

10. The point cloud encoding method according to any one of claims 6 to 8, characterized in that, Filling the point cloud media track with quality indication information corresponding to the point cloud bitstream, including: In the file encapsulation information of the point cloud media track, determine the quality indicator field corresponding to the quality indicator information; The quality indicator information corresponding to the point cloud code stream is filled into the quality indicator field in the file encapsulation information.

11. A point cloud decoding device, characterized in that, include: The receiving module is configured to receive point cloud files transmitted from a data source. The point cloud files encapsulate replaceable groups corresponding to different point cloud media tracks. Point cloud media tracks with the same point cloud content but different point cloud qualities are grouped into the same replaceable group. When the point cloud data is encapsulated as a single track, the tracks of point cloud content with different qualities belong to the same replaceable group. When the point cloud data is encapsulated as multiple tracks, the geometric component tracks of point cloud content with different qualities belong to the same replaceable group, while the attribute component tracks are associated with the geometric component tracks. The parsing module is configured to parse the file encapsulation information of the point cloud media track to obtain the quality indication information carried in the file encapsulation information. The quality indication information is used to represent the point cloud quality of the point cloud media track. The point cloud quality includes at least one of the bitrate and frame rate of the point cloud bitstream. The decoding module is configured to select and decode a point cloud media track with a specified point cloud quality from the point cloud file based on the quality indication information carried in the file encapsulation information.

12. A point cloud encoding device, characterized in that, include: The encoding module is configured to encode the point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams with the same point cloud content but different point cloud quality, wherein the point cloud quality includes at least one of the bit rate and frame rate of the point cloud bitstream. The filling module is configured to fill the point cloud bitstream with quality indication information representing the quality of the point cloud according to the encoding standard. The encapsulation module is configured to encapsulate the point cloud stream into point cloud media tracks within a point cloud file, and to fill the point cloud media tracks with quality indication information corresponding to the point cloud stream. The point cloud file encapsulates replaceable groups corresponding to different point cloud media tracks. Point cloud media tracks with the same point cloud content but different point cloud qualities are grouped into the same replaceable group. When point cloud data is encapsulated as a single track, tracks of point cloud content with different qualities belong to the same replaceable group. When point cloud data is encapsulated as multiple tracks, geometric component tracks of point cloud content with different qualities belong to the same replaceable group, while attribute component tracks are associated with geometric component tracks.

13. A computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the method of any one of claims 1 to 10.

14. An electronic device, characterized in that, include: processor; as well as Memory for storing the executable instructions of the processor; The processor is configured to execute the method of any one of claims 1 to 10 by executing the executable instructions.

Images