Point cloud encoding / decoding method, device, computer-readable medium, and electronic device

Abstract

The present application belongs to the field of computer and communication technology, and specifically relates to a point cloud encoding and decoding method, a point cloud encoding and decoding device, a computer-readable medium, and an electronic device. In an embodiment of the present application, the point cloud decoding method includes the steps of: receiving a point cloud file transmitted by a data source, the point cloud file including at least one point cloud media track; analyzing file encapsulation information of the at least one point cloud media track to obtain quality indication information carried in the file encapsulation information, the quality indication information being used to represent the point cloud quality of the at least one point cloud media track; and selecting and decoding a point cloud media track having a specified point cloud quality from the point cloud file according to the quality indication information carried in the file encapsulation information.

Description

[Technical field]

[0001] The present application relates to the field of computer and communication technology, and in particular to a point cloud encoding / decoding method, a point cloud encoding / decoding device, a computer-readable medium, and an electronic device.

[0002] This application claims priority to a Chinese patent application filed on March 31, 2021, bearing application number 202110351657.2 and titled "Point cloud encoding and decoding method, apparatus, computer-readable medium, and electronic device." [Background technology]

[0003] A point cloud is a set of discrete points that are irregularly distributed in space and represent the spatial structure and surface attributes of a three-dimensional object or scene. After a large-scale point cloud data is acquired by a point cloud collection device, the point cloud data can be encoded and encapsulated for transmission and presentation to a user. Summary of the Invention [Problem to be solved by the invention]

[0004] The embodiments of the present application provide a point cloud encoding / decoding method, a point cloud encoding / decoding device, a computer-readable medium, and an electronic device. [Means for solving the problem]

[0005] According to one aspect of an embodiment of the present application, a point cloud decoding method is provided, the method including: receiving a point cloud file transmitted by a data source, the point cloud file including at least one point cloud media track; analyzing file encapsulation information of the at least one point cloud media track to obtain quality indication information carried by the file encapsulation information, the quality indication information being used to represent point cloud quality of the at least one point cloud media track; and selecting and decoding a point cloud media track having a specified point cloud quality from the point cloud file based on the quality indication information carried by the file encapsulation information.

[0006] According to one aspect of an embodiment of the present application, a point cloud decoding apparatus is provided, the apparatus including: a receiving module configured to receive a point cloud file transmitted by a data source, the point cloud file including at least one point cloud media track; an analysis module configured to analyze file encapsulation information of the at least one point cloud media track to obtain quality indication information carried by the file encapsulation information, the quality indication information being used to represent a point cloud quality of the at least one point cloud media track; and a decoding module configured to select and decode a point cloud media track having a specified point cloud quality from the point cloud file based on the quality indication information carried by the file encapsulation information.

[0007] In some embodiments of the present application, based on the above technical solutions, the receiving module includes: a signaling receiving unit configured to receive a stream media signaling used for transmitting point cloud data sent from a data source; a signaling analysis unit configured to analyze the stream media signaling to obtain at least two kinds of selectable quality indication information carried by the stream media signaling; a request sending unit configured to send a data transmission request to the data source based on the quality indication information selected from the at least two kinds of quality indication information; and a file receiving unit configured to receive a point cloud file corresponding to the data transmission request transmitted by the data source.

[0008] In some embodiments of the present application, based on the above technical solutions, the request sending unit includes: a bandwidth acquisition subunit configured to determine a network bandwidth for data transmission with the data source; a bandwidth matching subunit configured to select a target point cloud quality matching the network bandwidth by performing matching detection between the network bandwidth and at least two kinds of quality indication information carried by the stream media signaling; and a request sending subunit configured to send a data transmission request generated based on the target point cloud quality to the data source.

[0009] In some embodiments of the present application, based on the above technical solutions, the analysis module includes: an information analysis unit configured to determine at least one quality indication field related to quality parameters of the point cloud media track by analyzing file encapsulation information of the at least one point cloud media track; and an information determination unit configured to determine quality indication information of the point cloud media file based on the numerical value of the at least one quality indication field.

[0010] In some embodiments of the present application, based on the above technical solutions, the quality indication information includes at least one of a quality true value, a quality equivalent value, and a quality level, the quality true value being a parameter value of the quality parameter, the quality equivalent value being a quantity of a unit quality parameter obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter, and the quality level being level information used to represent a parameter value range of the quality parameter.

[0011] In some embodiments of the present application, based on the above technical solutions, the quality parameters include at least one of a bit rate and a frame rate of the point cloud bitstream.

[0012] According to one aspect of an embodiment of the present application, a point cloud encoding method is provided, the method including: performing encoding processes on point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams having the same point cloud content but different point cloud qualities; filling the point cloud bitstream with quality indication information used to represent the point cloud quality based on the encoding standard; encapsulating the point cloud bitstream as a point cloud media track, and filling the point cloud media track with quality indication information corresponding to the point cloud bitstream.

[0013] According to one aspect of an embodiment of the present application, a point cloud encoding apparatus is provided, the apparatus including: an encoding module configured to perform encoding processes on point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams having the same point cloud content but different point cloud qualities; a filling module configured to fill quality indication information used to represent the point cloud quality into the point cloud bitstream based on the encoding standard; and an encapsulation module configured to encapsulate the point cloud bitstream as a point cloud media track and fill quality indication information corresponding to the point cloud bitstream into the point cloud media track.

[0014] In some embodiments of the present application, based on the above technical solutions, the point cloud encoding device further includes: a signaling generation module configured to generate a stream media signaling used for transmitting point cloud data; a signaling filling module configured to fill quality indication information corresponding to each of the point cloud bitstreams into the stream media signaling; and a signaling transmission module configured to transmit the stream media signaling to a data receiving side.

[0015] In some embodiments of the present application, based on the above technical solutions, the point cloud encoding device further includes: a request receiving module configured to receive a data transmission request generated based on the stream media signaling sent from the data receiving side; and a file transmission module configured to transmit a point cloud file to the data receiving side based on the data transmission request, where the point cloud file includes point cloud media tracks having the same point cloud content but different point cloud qualities.

[0016] In some embodiments of the present application, based on the above technical solutions, the filling module includes: a value determination unit configured to determine a parameter value of a quality parameter of the point cloud bitstream based on the encoding standard, and to determine a quality indication field corresponding to the quality parameter in the point cloud bitstream; a first information determination unit configured to determine quality indication information used to represent the point cloud quality based on the parameter value of the quality parameter; and a first information filling unit configured to fill the quality indication information into the quality indication field based on the correspondence relationship between the quality parameter and the quality indication field.

[0017] In some embodiments of the present application, based on the above technical solutions, the encapsulation module comprises: a second information determining unit configured to determine a quality indication field in file encapsulation information of the point cloud media track corresponding to the quality indication information; and a second information filling unit configured to fill quality indication information corresponding to the point cloud bitstream into a quality indication field in the file encapsulation information.

[0018] According to one aspect of an embodiment of the present application, a computer-readable medium is provided, on which a computer program is stored, which, when executed by a processor, realizes the method in the above technical solution.

[0019] According to one aspect of an embodiment of the present application, an electronic device is provided, the electronic device including a processor and a memory used to store executable instructions of the processor, the processor being configured to perform the method in the above technical solution by executing the executable instructions.

[0020] According to one aspect of the embodiment of the present application, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium, a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method in the above technical solution.

[0021] In the technical solution provided by the embodiments of the present application, by adding quality indication information used to represent point cloud quality in the process of point cloud data encoding and file encapsulation, the quality level of the point cloud file and each component (such as geometry and attributes) can be clearly indicated, so that the client can more accurately request the corresponding point cloud file, and can also select the corresponding components based on the client's own needs and performance conditions when decoding and presenting.

[0022] It should be understood that the above general description and the following detailed description are only exemplary and explanatory and are not intended to limit the present application. [Brief description of the drawings]

[0023] [Figure 1] 1 shows a schematic diagram of an exemplary system architecture to which the technical solutions of the embodiments of the present application can be applied. [Diagram 2] This shows a method of placing a point cloud encoding device and a point cloud decoding device in a streaming transmission environment. [Diagram 3] 1 shows a step flowchart of a point cloud decoding method in one embodiment of the present application. [Figure 4] 1 illustrates a schematic diagram of interchangeable groups encapsulated in multiple tracks in one embodiment of the present application. [Diagram 5]1 illustrates a flowchart of steps for receiving a point cloud file from a data source in one embodiment of the present application. [Figure 6] 1 shows a step flowchart of a point cloud encoding method in one embodiment of the present application. [Figure 7] 1 illustrates a schematic diagram of the upper layer syntax of a GPCC bitstream in one embodiment of the present application. [Figure 8] 1 illustrates a step flow chart of point cloud data transmission using bit rate as quality indication information in one embodiment of the present application. [Figure 9] 1 illustrates a step flow chart of point cloud data transmission using frame rate as quality indication information in one embodiment of the present application. [Figure 10] Schematically illustrates a structural block diagram of a point cloud decoding device provided by an embodiment of the present application. [Figure 11] FIG. 2 illustrates a structural block diagram of a point cloud encoding device provided by an embodiment of the present application; [Figure 12] FIG. 1 illustrates a schematic block diagram of an architecture of a computer system of an electronic device suitable for use in implementing embodiments of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] Hereinafter, exemplary embodiments will be described more completely with reference to the drawings. However, the exemplary embodiments can be implemented in a variety of forms and should not be understood to be limited to the exemplary examples detailed herein, but rather, these embodiments are provided to make the present application more complete and complete and to fully convey the concept of the exemplary embodiments to those skilled in the art.

[0025] Furthermore, the described features, structures, or characteristics may be incorporated in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a thorough understanding of the embodiments of the present application. However, as will be understood by those skilled in the art, the technical solutions of the present application can be implemented without one or more of the specific details, or other methods, components, devices, steps, etc. can be employed. In other circumstances, well-known methods, devices, implementations, or operations are not shown or described in detail to avoid obscuring aspects of the present application.

[0026] The block diagrams shown in the drawings are merely functional entities that do not necessarily correspond to physically separate entities, i.e. they can be implemented by adopting the form of software, or in one or more hardware modules or integrated circuits, or in different networks and / or processor and / or microcontroller devices.

[0027] The flowcharts shown in the drawings are merely exemplary illustrations, and do not necessarily include all contents and operations / steps, and do not necessarily execute in the order described. For example, some operations / steps may be further decomposed, and some operations / steps may be combined or partially combined, and therefore the actual execution order may change based on the actual situation.

[0028] A point cloud is a set of discrete points that are irregularly distributed in space and represent the spatial structure and surface attributes of a three-dimensional object or scene. Each point in a point cloud has at least three-dimensional position information, and may further have color, material, or other information based on different application scenes. Usually, each point in a point cloud has the same number of additional attributes. From the viewpoint of encoding method, point cloud media can be divided into point cloud media compressed based on traditional video encoding method (Video-based Point Cloud Compression, VPCC) and point cloud media compressed based on geometric features (Geometry-based Point Cloud Compression, GPCC). In the file encapsulation of point cloud media, the three-dimensional position information is usually called the Geometry Component of the point cloud file, and the attribute information is called the Attribute Component of the point cloud file. One point cloud file may have only one geometric component, but there may be one or more attribute components.

[0029] Point clouds can flexibly and easily represent the spatial structure and surface attributes of three-dimensional objects or scenes. Therefore, they are widely used, and their main application scenes can be broadly classified into two types: 1) point clouds sensed by machines, such as autonomous navigation systems, real-time patrol systems, geographic information systems, visual sorting robots, and disaster relief robots; and 2) point clouds sensed by human eyes, such as digital cultural heritage, free viewpoint broadcasting, three-dimensional immersive communication, and three-dimensional immersive interaction.

[0030] The acquisition of point clouds mainly includes computer generation, 3D laser scanning, and 3D photography measurement. Computers can generate point clouds of virtual three-dimensional objects and scenes. 3D scanning can obtain point clouds of static real-world three-dimensional objects or scenes, and can obtain millions of point clouds per second. 3D imaging can obtain point clouds of dynamic real-world three-dimensional objects or scenes, and can obtain tens of millions of point clouds per second. In addition, in the medical field, MRI, CT, and electromagnetic positioning information can obtain point clouds of biological tissues and organs. These technologies reduce the cost and time period of point cloud data acquisition and improve the accuracy of data. The transformation of the point cloud data acquisition method enables the acquisition of a large amount of point cloud data. With the constant accumulation of large-scale point cloud data, efficient storage, transmission, distribution, sharing, and standardization of point cloud data have become the key points of point cloud applications.

[0031] After the point cloud media is encoded, the encoded data stream needs to be encapsulated and transmitted to the user, so that the point cloud media player needs to first decapsulate the point cloud file, then decode it, and finally present the decoded data stream.

[0032] FIG. 1 shows a schematic diagram of an exemplary system architecture to which the technical solutions of the embodiments of the present application can be applied.

[0033] As shown in Fig. 1, the system architecture 100 includes a plurality of terminal devices, which can communicate with each other, for example, via a network 150. For example, the system architecture 100 may include a first terminal device 110 and a second terminal device 120 connected with each other via the network 150. In the embodiment of Fig. 1, the first terminal device 110 and the second terminal device 120 perform unidirectional data transmission.

[0034] For example, the first terminal device 110 can encode point cloud data (e.g., a point cloud bitstream collected by the first terminal device 110) and transmit the encoded point cloud data to the second terminal device 120 via the network 150, and the encoded point cloud data is transmitted in the form of one or more encoded point cloud bitstreams. The second terminal device 120 can receive the encoded point cloud data from the network 150, decode the encoded point cloud data, and display the decoded point cloud data.

[0035] In one embodiment of the present application, the system architecture 100 may include a third terminal device 130 and a fourth terminal device 140 performing bidirectional transmission of encoded point cloud data, which may occur, for example, during a video conference. For the bidirectional data transmission, each of the third terminal device 130 and the fourth terminal device 140 may perform encoding on point cloud data (e.g., a point cloud bitstream collected by the terminal device) and transmit it to the other of the third terminal device 130 and the fourth terminal device 140 via the network 150. Each of the third terminal device 130 and the fourth terminal device 140 may further receive the encoded point cloud data transmitted by the other of the third terminal device 130 and the fourth terminal device 140, decode the encoded point cloud data to recover the point cloud data, and display the point cloud data on an accessible display device based on the recovered point cloud data.

[0036] In the embodiment of FIG. 1, the first terminal device 110, the second terminal device 120, the third terminal device 130, and the fourth terminal device 140 may be a server, a personal computer, and a smartphone, but the principles disclosed herein are not limited thereto. The embodiments disclosed herein apply to laptop computers, tablet computers, media players, and / or dedicated video conferencing equipment. The network 150 represents any number of networks that transfer the encoded point cloud data between the first terminal device 110, the second terminal device 120, the third terminal device 130, and the fourth terminal device 140, including, for example, wired and / or wireless communication networks. The network 150 may exchange data in circuit-switched and / or packet-switched channels. The network may include a telecommunications network, a local area network, a wide area network, and / or the Internet. For purposes of this application, unless otherwise interpreted below, the architecture and topology of the network 150 may not be important to the operation disclosed herein.

[0037] In one embodiment of the present application, Fig. 2 illustrates an installation scheme of a point cloud encoding device and a point cloud decoding device in a streaming transmission environment. The subject matter disclosed in the present application can be similarly applied to other applications supporting point clouds, including, for example, video conferencing, digital television, and storage of compressed point cloud data on digital media, including CDs, DVDs, memory sticks, etc.

[0038] The streaming transmission system may include a collection subsystem 213, which may include a point cloud data source 201, such as a digital camera, which may generate uncompressed point cloud data 202. In an embodiment, the point cloud data 202 includes samples captured by a digital camera. Compared to the encoded point cloud data 204 (or the encoded point cloud bitstream 204), the point cloud data 202 is rendered as a thick line to emphasize the high amount of point cloud data. The point cloud data 202 may be processed by an electronic device 220, which includes a video encoder 203 coupled to the video source 201. The video encoder 203 may include hardware, software, or a combination of software and hardware to realize or perform aspects of the disclosed subject matter, which are described in more detail below. Compared to the point cloud data 202, the encoded point cloud data 204 (or the encoded point cloud bitstream 204) is rendered as thin lines to emphasize the relatively low amount of data of the encoded point cloud data 204 (or the encoded point cloud bitstream 204), and is stored in the streaming transmission server 205 for future use. One or more streaming transmission client subsystems, such as the client subsystem 206 and the client subsystem 208 in FIG. 2, can access the streaming transmission server 205 to retrieve the encoded point cloud data 207 and the point cloud data 209, which are copies of the point cloud data 204. The client subsystem 206 may include a point cloud decoder 210, for example, in the electronic device 230. The point cloud decoder 210 decodes the transmitted copy of the encoded point cloud data 207 and generates output point cloud data 211, which can be presented on a display 212 (e.g., a display screen) or other presentation device.In some streaming transmission systems, encoding may be performed on the encoded point cloud data 204, point cloud data 207, and point cloud data 209 (e.g., point cloud bitstream) based on certain point cloud encoding / compression standards. Examples of these standards may include standards developed by MPEG for the GPCC.

[0039] It should be noted that the electronic device 220 and the electronic device 230 may include other components not shown in the drawings. For example, the electronic device 220 may include a point cloud decoding device, and the electronic device 230 may further include a point cloud encoding device.

[0040] The following describes in detail the technical solutions, including a point cloud encoding / decoding method, a point cloud encoding / decoding device, a computer-readable medium, and an electronic device, provided by the present application in conjunction with specific embodiments.

[0041] FIG. 3 shows a step flow chart of a point cloud decoding method in an embodiment of the present application. The method can be applied to a server, a client, an intermediate node, etc. of a point cloud media system. The embodiment of the present application takes the point cloud decoding method executed by a client device equipped with a point cloud decoding device as an example. As shown in FIG. 3, the point cloud decoding method may mainly include the following steps S310 to S330.

[0042] Step S310: Receive a point cloud file transmitted by a data source, where the point cloud file includes at least one point cloud media track.

[0043] According to an embodiment of the present application, in step S310, the point cloud file may include point cloud media tracks with the same point cloud content but different point cloud qualities. Alternative groups corresponding to different point cloud media tracks in the point cloud file may be encapsulated, and point cloud media tracks with the same point cloud content but different point cloud qualities may be separated into the same alternative group. When GPCC point cloud data is encapsulated in a single track, the tracks of point cloud content with different qualities belong to the same alternative group. When GPCC point cloud data is encapsulated in multiple tracks, the geometric component tracks of point cloud content with different qualities belong to the same alternative group, but the attribute component tracks can be connected to the geometric component tracks.

[0044] 4 shows a schematic diagram of a fungible group encapsulated in multiple tracks in one embodiment of the present application. As shown in FIG. 4, a fungible group 400 includes a first point cloud data 410 and a second point cloud data 420 having the same point cloud content. Here, the first point cloud data 410 is lossless compressed point cloud data (Lossless coded GPCC) with a relatively high point cloud quality, and the second point cloud data 420 is lossy compressed point cloud data (Lossy coded GPCC) with a relatively low point cloud quality.

[0045] The first point cloud data 410 includes a first geometric component track 411 and a first attribute component track 412 connected to the first geometric component track 411, and the second point cloud data 420 includes a second geometric component track 421 and a second attribute component track 422 connected to the second geometric component track 421.

[0046] Step S320: Analyze the file encapsulation information of the at least one point cloud media track to obtain quality indication information carried in the file encapsulation information, and the quality indication information is used to represent the point cloud quality of the at least one point cloud media track.

[0047] The file encapsulation information is a data box used to record decoding configuration data related to a point cloud file generated when encapsulating a point cloud bitstream as a point cloud file, and may be, for example, a GPCC decoder configuration record data box (GPCCDecoderConfigurationRecord).

[0048] In one embodiment of the present application, a method for analyzing file encapsulation information to obtain quality indication information may include: determining at least one quality indication field associated with a quality parameter of the point cloud media track by analyzing the file encapsulation information of the point cloud media track; and determining quality indication information of the point cloud media file based on a numerical value of the at least one quality indication field.

[0049] In one embodiment of the present application, the quality parameters of the point cloud media track may include at least one of a bit rate and a frame rate of the point cloud bitstream, and in some other alternative embodiments, the quality parameters may further include other parameters related to the media resource quality, such as resolution and image quality.

[0050] In one embodiment of the present application, the quality indication information includes at least one of a quality true value, a quality equivalent value, and a quality level.

[0051] The quality true value is the parameter value of the quality parameter. For example, if the bit rate of the corresponding point cloud bit stream of one point cloud media track is 10000bit / s, the quality true value 10000 can be determined as the quality indication information of the point cloud media track. For example, if the frame rate of the corresponding point cloud bit stream of one point cloud media track is 30fps, the quality true value 30 can be determined as the quality indication information of the point cloud media track.

[0052] The quality equivalent value is the quantity of unit quality parameters obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter. For example, if 400 bit / s is the unit quality parameter and the bit rate of the corresponding point cloud bit stream of one point cloud media track is 10000 bit / s, the quality equivalent value 10000 / 400=25 can be the quality indication information. When the ratio between the parameter value of the quality parameter and the preset unit quality parameter is a decimal, the quantity of the unit quality parameter can be determined by rounding up the ratio.

[0053] The quality level is level information used to represent the parameter value range of the quality parameter. For example, for the parameter bit rate, multiple different bit rate range values ​​can be pre-set, each bit rate range value corresponds to a bit rate level, which is the quality level used to represent the point cloud quality.

[0054] In one embodiment of the present application, the syntax of the GPCC Decoder Configuration Record Data Box for File Encapsulation Information is as follows:

[0055] aligned(8) class GPCCDecoderConfigurationRecord { unsigned int(8) configurationVersion = 1; unsigned int(8) profile_idc; unsigned int(24) profile_compatibility_flags; unsigned int(8) level_idc; unsigned int(8) bitrate; unsigned int(8) frame_rate; unsigned int(8) numOfSetupUnits; for (i=0; i<numOfSetupUnits; i++) { tlv_encapsulation setupUnit; / / as defined in ISO / IEC 23090-9 } / / additional fields }

[0056] Here, bitrate is a quality indication field corresponding to the bit rate, the value of which is an unsigned integer having a length of 8 bytes, and frame_rate is a quality indication field corresponding to the frame rate, the value of which is also an unsigned integer having a length of 8 bytes. The frame rate represented by the quality indication field frame_rate may be the average frame rate of a certain time domain level, and the unit is frames / (256 seconds). When the value of the quality indication field frame_rate is 0, it represents that the frame rate is not specified, for example, the average frame rate is not specified. For a GPCC bitstream, a GPCC time domain level may be a subset of frames in the GPCC bitstream, and the frame rate of the subsequence composed of the subset of frames is smaller than the frame rate of the actual bitstream sequence of the GPCC bitstream. Each GPCC frame may be associated with one particular time domain level. The GPCC bitstream may be loaded or stored in one or more time domain level tracks.

[0057] Step S330: According to the quality indication information carried by the file encapsulation information, select and decode a point cloud media track having a specified point cloud quality from the point cloud file.

[0058] Each point cloud media track and corresponding file encapsulation information carry quality indication information of the point cloud media track, and the quality indication information identifies the point cloud quality of the point cloud media track in an explicit identification manner. When the point cloud file is transmitted by the data source to the data sink where the user is located, the data sink can decode the point cloud media track with the specified point cloud quality according to the device capabilities and the user needs.

[0059] In one embodiment of the present application, the device performance of the data receiving side is collected, and a matching detection is performed between the device performance and the quality indication information carried by the file encapsulation information, thereby determining a point cloud quality that matches the device performance of the data receiving side, and further selecting and decrypting a point cloud media track having a specified point cloud quality from the point cloud file.

[0060] The device performance may include at least one of hardware performance, software performance, and network performance. The hardware performance may include, for example, the device model number, processor model number, memory capacity, and display size of the electronic device. The software performance may include, for example, the program version of the point cloud decoder installed on the data receiving side. The network performance may include, for example, the network bandwidth, and the network transmission state.

[0061] In one embodiment of the present application, a quality selection rule configured by a data receiving side is obtained, and a matching detection is performed between the quality selection rule and the quality indication information carried by the file encapsulation information, a point cloud quality that matches the quality selection rule configured by the data receiving side is determined, and a point cloud media track having the specified point cloud quality is selected and decoded from the point cloud file.

[0062] The quality selection rule may be a selection rule used to select point cloud data having a specified point cloud quality configured based on a user's needs, for example, selecting point cloud data whose bit rate is greater than (or less than) a specified value based on user instructions.

[0063] Figure 5 shows a step flow chart of receiving a point cloud file from a data source in one embodiment of the present application. As shown in Figure 5, based on the above embodiment, the step of receiving a point cloud file transmitted by a data source in step S310 may include the following steps S510 to S540.

[0064] Step S510: Receive a stream media signaling sent from a data source, which is used for transmitting point cloud data.

[0065] In one embodiment of the present application, the stream media signaling used to transmit the point cloud data may be dynamic adaptive streaming over HTTP (DASH) signaling. DASH is an adaptive bitrate streaming technology that enables high-quality stream media to be transmitted over the Internet via a conventional HTTP network server.

[0066] Step S520: Analyze the streaming media signaling to obtain at least two kinds of selectable quality indication information carried by the streaming media signaling.

[0067] In DASH signaling, existing fields can be used to store selectable quality indication information. For example, a bandwidth field in DASH signaling can be used to indicate the bit rate of multiple different point cloud media tracks, and a frameRate field in DASH signaling can be used to indicate the frame rate of multiple different point cloud media tracks. In DASH technology, a combination of one or more media components is one Representation, for example, a video file of a certain resolution can be regarded as one Representation. Based on the embodiment of the present application, a media file of a point cloud media track can be a Representation, and the quality indication information of different point cloud media tracks may be represented by the frameRate parameter and / or the bandwidth parameter of the corresponding Representation.

[0068] Step S530: Send a data transmission request to a data source according to the quality indication information selected from the at least two kinds of quality indication information.

[0069] Based on the quality indication information carried by the stream media signaling obtained by the analysis, one or more of the quality indication information can be selected as a target point cloud quality, and a data transmission request corresponding to the target point cloud quality can be further sent to the data source.

[0070] In one embodiment of the present application, a method for sending a data transmission request may include the steps of determining a data source and a network bandwidth for data transmission, selecting a target point cloud quality matching the network bandwidth by performing matching detection between the network bandwidth and at least two kinds of quality indication information carried by the stream media signaling, and sending a data transmission request generated based on the target point cloud quality to the data source.

[0071] In one embodiment of the present application, two or more target point cloud qualities can be chosen when the network bandwidth is greater than a set threshold, and one target point cloud quality can be chosen when the network bandwidth is less than or equal to a set threshold.

[0072] Step S540: Receive a point cloud file transmitted by a data source, the point cloud file corresponding to a data transmission request.

[0073] When sending a data transmission request corresponding to a target point cloud quality to the data source according to the quality indication information, the data source can transmit a corresponding point cloud media track to the data receiving side according to the request.When sending multiple data transmission requests corresponding to the target point cloud qualities to the data source according to the quality indication information, the data source can transmit multiple corresponding point cloud media tracks with different point cloud qualities to the data receiving side according to the request.

[0074] FIG. 6 shows a step flow chart of a point cloud encoding method in one embodiment of the present application. The point cloud encoding method can be applied to a server, a client, an intermediate node, etc. of a point cloud media system. The embodiment of the present application takes as an example a point cloud encoding method executed by a server device equipped with a point cloud encoding device. As shown in FIG. 6, the point cloud encoding method may mainly include the following steps S610 to S630.

[0075] Step S610: Perform encoding processes on the point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams with the same point cloud content but different point cloud qualities.

[0076] In order to meet the quality needs of different data receivers for point cloud data, for the point cloud data of a certain point cloud content, point cloud bitstreams with different point cloud qualities can be obtained after encoding according to multiple different encoding standards. The encoding standard may include parameter values ​​of one or multiple quality parameters, and different parameter values ​​of various quality parameters can be combined to form multiple different encoding standards. For example, the quality parameters include bit rate and frame rate, and the bit rate includes two different bit rate values ​​A1 and A2, and the frame rate also includes two different frame rate values ​​B1 and B2, so that four encoding standards corresponding to different quality parameter values, namely A1B1, A1B2, A2B1, and A2B2, can be determined.

[0077] Step S620: Fill the point cloud bitstream with quality indication information used to represent the point cloud quality according to the encoding standard.

[0078] In one embodiment of the present application, a method for filling quality indication information into a point cloud bitstream may include: determining a parameter value of a quality parameter of the point cloud bitstream according to an encoding standard, and determining a quality indication field in the point cloud bitstream corresponding to the quality parameter; determining quality indication information used to represent point cloud quality according to the parameter value of the quality parameter; and filling the quality indication field with the quality indication information according to the corresponding relationship between the quality parameter and the quality indication field. The quality indication information representing point cloud quality may be included in an upper layer syntax structure in the point cloud bitstream, for example, in a sequence parameter set syntax.

[0079] Figure 7 shows a schematic diagram of the upper layer syntax of a GPCC bitstream in one embodiment of the present application. As shown in Figure 7, in the sequence parameter set syntax of the point cloud data bitstream, there are multiple quality indication fields corresponding to quality parameters. Here, the bitrate field is a quality indication field corresponding to a bitrate, and the value is an unsigned integer with a length of 32 bytes, and the frame_rate field is a quality indication field corresponding to a frame rate, and the value is an unsigned integer with a length of 8 bytes.

[0080] In one embodiment of the present application, the quality parameters of the point cloud bitstream may include at least one of a bit rate and a frame rate, and in some other alternative embodiments, the quality parameters may further include other parameters related to the media resource quality, such as resolution and image quality.

[0081] In one embodiment of the present application, the quality indication information includes at least one of a quality true value, a quality equivalent value, and a quality level.

[0082] The quality true value is the parameter value of the quality parameter. For example, if the bit rate of one point cloud bit stream is 10000bit / s, the quality true value 10000 can be determined as the quality indication information of the point cloud bit stream. For example, if the frame rate of one point cloud bit stream is 30fps, the quality true value 30 can be determined as the quality indication information of the point cloud bit stream.

[0083] The quality equivalent value is the quantity of unit quality parameters obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter. For example, if 400 bit / s is the unit quality parameter and the bit rate of one point cloud bit stream is 10000 bit / s, the quality equivalent value 10000 / 400=25 can be the quality indication information. When the ratio between the parameter value of the quality parameter and the preset unit quality parameter is a decimal, the quantity of the unit quality parameter can be determined by rounding up the ratio.

[0084] The quality level is level information used to represent the parameter value range of the quality parameter. For example, for the parameter bit rate, multiple different bit rate range values ​​can be pre-set, each bit rate range value corresponds to a bit rate level, which is the quality level used to represent the point cloud quality.

[0085] Step S630: Encapsulate the point cloud bitstream as a point cloud media track, and fill the quality indication information corresponding to the point cloud bitstream into the point cloud media track.

[0086] Each point cloud media track has a file encapsulation information corresponding thereto, which may be, for example, a data box generated when encapsulating a point cloud bitstream into a point cloud file, used for recording decoding configuration data related to the point cloud file, such as a GPCC decoder configuration record data box (GPCCDecoderConfigurationRecord). After determining a quality indication field corresponding to quality indication information in the file encapsulation information of the point cloud media track, the quality indication information corresponding to the point cloud bitstream can be filled into the quality indication field in the file encapsulation information by quoting command indication information of the point cloud bitstream.

[0087] In one embodiment of the present application, after the point cloud bitstream is encapsulated as a point cloud media track, a stream media signaling can be generated according to data transmission needs for transmitting the point cloud data, and the stream media signaling can be the DASH signaling in the above embodiment. Fill the quality indication information corresponding to each point cloud bitstream in the stream media signaling. The filling manner can be filling the existing field in the DASH signaling with a value according to the quality parameter information of the point cloud media track. Then, the stream media signaling is sent to the data receiving side, thereby performing point cloud data transmission between the data source and the data receiving side.

[0088] In one embodiment of the present application, after the data sink responds to the stream media signaling, the data source can receive a data transmission request generated according to the stream media signaling sent by the data sink, and transmit a point cloud file to the data sink according to the data transmission request, where the point cloud file includes point cloud media tracks having the same point cloud content and different point cloud qualities.

[0089] Fig. 8 shows a step flow chart of transmitting point cloud data using bit rate as quality indication information in one embodiment of the present application. As shown in Fig. 8, a server is a data source that generates point cloud data, and a method of transmitting point cloud data between the server and a client where a user is located may include the following steps S801 to S806.

[0090] Step S801: Encode the point cloud content A in the server to obtain point cloud bitstreams S1 and S2 corresponding to two different bitrates, and fill the bitrate field in each bitstream according to the actual bitstream. For example, fill bitrate=10000 in the point cloud bitstream S1, and fill bitrate=20000 in the point cloud bitstream S2.

[0091] Step S802: Encapsulate S1 and S2 as two different point cloud media tracks T1 and T2 respectively, and fill the bitrate fields of the GPCCDecoderConfigurationRecord data boxes in T1 and T2 correspondingly, for example, fill bitrate=10000 in the GPCCDecoderConfigurationRecord data box of point cloud media track T1, and fill bitrate=20000 in the GPCCDecoderConfigurationRecord data box of point cloud media track T2.

[0092] Step S803: Use the existing bandwidth field in the DASH signaling to indicate the bit rates of T1 and T2, and send the DASH signaling to clients C1 and C2 where the users are located respectively.

[0093] Step S804: Clients C1 and C2 request point cloud files based on network bandwidth and information in DASH signaling, and include T1 and T2 in the files.

[0094] Step S805: The server transmits the point cloud files to the clients C1 and C2, respectively.

[0095] Step S806: The client receives the point cloud file, and according to the bitrate field information in T1 and T2 and its own device capability, selects and decodes the point cloud media track in the replaceable group, and presents the decoded point cloud data. For example, C1 selects and decodes the T1 media file in the replaceable group, and C2 selects and decodes the T2 media file in the replaceable group, and presents it.

[0096] In an embodiment of the present application, in the point cloud file requested by the user, all resources in the replaceable group are included, and after receiving the point cloud file, selective decoding can be performed on the transmitted point cloud data.

[0097] Fig. 9 shows a step flow chart of transmitting point cloud data using frame rate as quality indication information in one embodiment of the present application. As shown in Fig. 9, a server is a data source that generates point cloud data, and a method of transmitting point cloud data between the server and a client where a user is located may include the following steps S901 to S906.

[0098] Step S901: Encode the point cloud content A in the server to obtain point cloud bitstreams S1 and S2 corresponding to two different bit rates, and fill the frame_rate field in each bitstream according to the actual bitstream, for example, fill frame_rate=30 in the point cloud bitstream S1, and fill frame_rate=60 in the point cloud bitstream S2.

[0099] Step S902: Encapsulate S1 and S2 as two different point cloud media tracks T1 and T2 respectively, and fill the frame_rate fields of the GPCCDecoderConfigurationRecord data boxes in T1 and T2 correspondingly, for example, fill frame_rate=30 in the GPCCDecoderConfigurationRecord data box of point cloud media track T1, and fill frame_rate=60 in the GPCCDecoderConfigurationRecord data box of point cloud media track T2.

[0100] Step S903: Use the existing frameRate field in the DASH signaling to indicate the frame rates of T1 and T2, and send the DASH signaling to clients C1 and C2 where the users are located respectively.

[0101] Step S904: Clients C1 and C2 request point cloud files based on network bandwidth and information in DASH signaling, where T1 and T2 are included in the file requested by C1. In one embodiment, only T1 is included in the file requested by C2.

[0102] Step S905: The server transmits the point cloud files to the clients C1 and C2, respectively.

[0103] Step S906: The client receives the point cloud file, and according to the frameRate field information in T1 and T2 and its own device capability, selects and decodes the point cloud media track in the replaceable group, and presents the decoded point cloud data. For example, C1 selects and decodes the T2 media file in the replaceable group, and C2 decodes and presents the T1 media file in the replaceable group.

[0104] In an embodiment of the present application, only a portion of resources in a replaceable group may be included in a point cloud file requested by a user, thereby achieving the purpose of saving network bandwidth.

[0105] In the technical solutions provided by the embodiments of the present application, by adding some descriptive fields to the system layer, including field extensions of the bitstream layer and the file encapsulation layer, the quality level of the point cloud file and each component (such as geometry and attributes) can be more clearly indicated, so that the client can more accurately request the corresponding point cloud file, and also select the corresponding components based on the client's own needs and performance conditions when decoding and presenting.

[0106] It should be noted that although the figures depict the steps of the methods herein in a particular order, this does not require or imply that the steps must be performed in that particular order or that the desired results can be achieved without performing all of the steps shown. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step, and / or a step may be broken down into multiple steps for execution.

[0107] The following describes an apparatus embodiment of the present application, which can be used to implement the point cloud encoding and decoding method in the above embodiment of the present application.

[0108] Fig. 10 is a schematic diagram showing a structural block diagram of a point cloud decoding apparatus provided by an embodiment of the present application. As shown in Fig. 10, the point cloud decoding apparatus 1000 may include: a receiving module 1010 configured to receive a point cloud file transmitted by a data source, the point cloud file including at least one point cloud media track; an analysis module 1020 configured to analyze file encapsulation information of the at least one point cloud media track to obtain quality indication information carried by the file encapsulation information, the quality indication information being used to represent the point cloud quality of the at least one point cloud media track; and a decoding module 1030 configured to select and decode a point cloud media track having a specified point cloud quality from the point cloud file according to the quality indication information carried by the file encapsulation information. According to an embodiment of the present application, the point cloud file received by the receiving module 1010 may include point cloud media tracks having the same point cloud content but different point cloud qualities.

[0109] In some embodiments of the present application, based on the above technical solutions, the receiving module 1010 includes: a signaling receiving unit configured to receive a stream media signaling used for transmitting point cloud data sent from a data source; a signaling analysis unit configured to analyze the stream media signaling to obtain at least two kinds of selectable quality indication information carried by the stream media signaling; a request sending unit configured to send a data transmission request to the data source based on the quality indication information selected from the at least two kinds of quality indication information; and a file receiving unit configured to receive a point cloud file corresponding to the data transmission request transmitted by the data source.

[0110] In some embodiments of the present application, based on the above technical solutions, the request sending unit includes: a bandwidth acquisition subunit configured to determine a network bandwidth for data transmission with the data source; a bandwidth matching subunit configured to select a target point cloud quality matching the network bandwidth by performing matching detection between the network bandwidth and at least two kinds of quality indication information carried by the stream media signaling; and a request sending subunit configured to send a data transmission request generated based on the target point cloud quality to the data source.

[0111] In some embodiments of the present application, based on the above technical solutions, the analysis module 1020 includes: an information analysis unit configured to determine at least one quality indication field related to quality parameters of the point cloud media track by analyzing file encapsulation information of the at least one point cloud media track; and an information determination unit configured to determine quality indication information of the point cloud media file based on the numerical value of the at least one quality indication field.

[0112] In some embodiments of the present application, based on the above technical solutions, the quality indication information includes at least one of quality true value, quality equivalent value, and quality level, where the quality true value is a parameter value of the quality parameter, the quality equivalent value is a quantity of a unit quality parameter obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter, and the quality level is level information used to represent a parameter value range of the quality parameter.

[0113] In some embodiments of the present application, based on the above technical solutions, the quality parameters include at least one of a bit rate and a frame rate of the point cloud bitstream.

[0114] Fig. 11 is a schematic block diagram of a structure of a point cloud encoding device provided by an embodiment of the present application. As shown in Fig. 11, the point cloud encoding device 1100 may include: an encoding module 1110 configured to perform encoding processes on point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams having the same point cloud content and different point cloud qualities, a filling module 1120 configured to fill quality indication information used to represent the point cloud quality into the point cloud bitstream according to the encoding standard, and an encapsulation module 1130 configured to encapsulate the point cloud bitstream as a point cloud media track and fill the quality indication information corresponding to the point cloud bitstream into the point cloud media track.

[0115] In some embodiments of the present application, based on the above technical solutions, the point cloud encoding device 1100 further includes: a signaling generation module configured to generate a stream media signaling used for transmitting point cloud data; a signaling filling module configured to fill quality indication information corresponding to each of the point cloud bitstreams into the stream media signaling; and a signaling transmission module configured to transmit the stream media signaling to a data receiving side.

[0116] In some embodiments of the present application, based on the above technical solutions, the point cloud encoding device 1100 further includes: a request receiving module configured to receive a data transmission request generated based on the stream media signaling sent from the data receiving side; and a file transmission module configured to transmit a point cloud file to the data receiving side based on the data transmission request, where the point cloud file includes point cloud media tracks having the same point cloud content and different point cloud qualities.

[0117] In some embodiments of the present application, based on the above technical solutions, the filling module 1120 includes: a value determination unit configured to determine a parameter value of a quality parameter of the point cloud bitstream based on the encoding standard, and to determine a quality indication field corresponding to the quality parameter in the point cloud bitstream; a first information determination unit configured to determine quality indication information used to represent the point cloud quality based on the parameter value of the quality parameter; and a first information filling unit configured to fill the quality indication information into the quality indication field based on the correspondence relationship between the quality parameter and the quality indication field.

[0118] In some embodiments of the present application, based on the above technical solutions, the encapsulation module 1130 includes: a second information determination unit configured to determine a quality indication field corresponding to the quality indication information in the file encapsulation information of the point cloud media track; and a second information filling unit configured to fill the quality indication information corresponding to the point cloud bitstream into a quality indication field in the file encapsulation information.

[0119] The specific details of the point cloud encoding and decoding device provided in each embodiment of the present application have already been described in detail in the corresponding method embodiments, so they will not be described in detail again here.

[0120] FIG. 12 is a schematic block diagram of a computer system of an electronic device used to implement an embodiment of the present application.

[0121] It should be noted that the electronic device computer system 1200 shown in FIG. 12 is merely an example and should not pose any limitations on the functionality and scope of use of the embodiments of the present application.

[0122] As shown in Fig. 12, the computer system 1200 includes a central processor 1201 (Central Processing Unit, CPU), which can execute various appropriate motions and processes based on programs stored in a read-only memory 1202 (Read-Only Memory, ROM) or loaded from a storage portion 1208 into a random access memory 1203 (Random Access Memory, RAM). Various programs and data required for system operation are further stored in the random access memory 1203. The central processor 1201, the read-only memory 1202, and the random access memory 1203 are coupled to each other via a bus 1204. An input / output interface 1205 (Input / Output interface, i.e., I / O interface) is also connected to the bus 1204.

[0123] An input section 1206 including a keyboard, a mouse, etc., an output section 1207 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc., a storage section 1208 including a hard disk, etc., and a communication section 1209 including a network interface card such as a local area network card and a modem, etc. are connected to the input / output interface 1205. The communication section 1209 executes communication processing via a network such as the Internet. A driver 1210 is also connected to the input / output interface 1205 as necessary. A removable medium 1211 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is attached to the driver 1210 as necessary, so that a computer program read from the driver 1210 can be easily installed in the storage section 1208 as necessary.

[0124] In particular, according to an embodiment of the present application, the process described in each method flowchart may be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, the computer program including program code used to execute the method illustrated in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network by the communication unit 1209 and / or installed from a removable medium 1211. When the computer program is executed by the central processor 1201, it performs various functions defined in the system of the present application.

[0125] It is necessary to explain that the computer-readable medium shown in the embodiments of the present application may be a computer-readable signal medium, or a computer-readable storage medium, or any combination of the above. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having one or more conductors, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact magnetic disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in conjunction with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, in which computer-readable program code is carried. Such a propagated data signal may take a number of forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program used by or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted by any suitable medium, including, but not limited to, wireless, wired, etc., or any suitable combination of the above.

[0126] Those skilled in the art can easily conceive of other implementations of the present application after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modifications, uses, or adaptations of the present application, which modifications, uses, or adaptations follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed herein.

[0127] It should be understood that the present application is not limited to the exact construction described above and illustrated in the drawings, and various modifications and changes can be made without departing from the scope thereof, which is limited only by the appended claims. [Explanation of symbols]

[0128] 110 First terminal device 120 Second Terminal Device 130 Third Terminal Device 140 4th Terminal Device 150 Network 201 Point Cloud Data Source 201 Video Sources 202 Point Cloud Data 203 Video Encoding Device 205 Streaming Transmission Server 206 Client Subsystem 208 Client Subsystem 209 Point Cloud Data 210 Point Cloud Decoder 211 Output point cloud data 212 Display 213 Collection Subsystem 220 Electronic equipment 230 Electronic equipment 400 Groups 410 1st point cloud data 411 First geometric component track 412 1st Attribute Component Track 420 2nd point cloud data 421 Second Geometric Component Track 422 Second Attribute Component Track 1000 Point Cloud Decoders 1010 Receiver Module 1020 Analysis Module 1030 Decryption Module 1100 Point Cloud Encoder 1110 Encoding Module 1120 Filling Module 1130 Encapsulation Module 1200 Computer Systems 1201 Central Processor 1203 Random Access Memory 1204 Bus 1205 Output Interface 1206 Input section 1207 Output part 1208 Memory part 1209 Communication section

Claims

1. 1. A computer implemented method for decoding a point cloud, comprising: receiving a point cloud file transmitted by a data source, the point cloud file includes at least one point cloud media track and encapsulates interchangeable groups corresponding to different point cloud media tracks; Point cloud media tracks having the same point cloud content but different point cloud qualities are placed in the same interchangeable group; when the point cloud file is encapsulated in a single track, tracks of point cloud content of different qualities belong to the same interchangeable group; When the point cloud file is encapsulated with multiple tracks, the geometric component tracks of different quality point cloud contents belong to the same interchangeable group, and the attribute component tracks are associated with the geometric component tracks; analyzing file encapsulation information of the at least one point cloud media track to obtain quality indication information carried by the file encapsulation information, the quality indication information being used to represent a point cloud quality of the at least one point cloud media track; and selecting and decoding a point cloud media track having a specified point cloud quality from the point cloud file based on quality indication information carried by the file encapsulation information.

2. The step of receiving the point cloud file transmitted by the data source includes: receiving a stream media signaling sent from a data source, the stream media signaling being used for transmitting point cloud data; Analyzing the streaming media signaling to obtain at least two selectable quality indication information carried by the streaming media signaling; sending a data transmission request to the data source based on the quality indication information selected from the at least two kinds of quality indication information; The method of claim 1 , further comprising: receiving a point cloud file transmitted by the data source corresponding to the data transmission request.

3. The step of sending a data transmission request to the data source based on the quality indication information selected from the at least two kinds of quality indication information includes: determining a network bandwidth for transmitting data to said data source; Selecting a target point cloud quality that matches the network bandwidth by performing matching detection between the network bandwidth and at least two kinds of quality indication information carried by the stream media signaling; 3. The method of claim 2, further comprising: sending to the data source a data transmission request generated based on the target point cloud quality.

4. The step of analyzing file encapsulation information of the at least one point cloud media track to obtain quality indication information carried by the file encapsulation information includes: determining at least one quality indication field relating to a quality parameter of the point cloud media track by analyzing file encapsulation information of the at least one point cloud media track; The method of any one of claims 1 to 3, further comprising the step of determining a quality indication information of the point cloud file based on the numerical value of the at least one quality indication field.

5. The method of claim 4, wherein the quality indication field represents a frame rate of the point cloud bitstream, and the value of the quality indication field is an unsigned integer that is 8 bytes in length.

6. 5. The point cloud decoding method according to claim 4, wherein the quality indication information includes at least one of a quality true value, a quality equivalent value, and a quality level, the quality true value being a parameter value of the quality parameter, the quality equivalent value being a quantity of a unit quality parameter obtained by comparing the parameter value of the quality parameter with a preset unit quality parameter, and the quality level being level information used to represent a parameter value range of the quality parameter.

7. The method of claim 4, wherein the quality indication field represents a bit rate of the point cloud bit stream, and the value of the quality indication field is an unsigned integer with a length of 32 bytes.

8. A computer-implemented method for decoding a point cloud, comprising: receiving a point cloud file transmitted by a data source, the point cloud file including at least one point cloud media track; analyzing file encapsulation information of the at least one point cloud media track to obtain quality indication information carried by the file encapsulation information, the quality indication information being used to represent a point cloud quality of the at least one point cloud media track; selecting and decoding a point cloud media track from the point cloud file having a specified point cloud quality based on quality indication information carried by the file encapsulation information; The step of receiving the point cloud file transmitted by the data source includes: receiving a stream media signaling sent from a data source, the stream media signaling being used for transmitting point cloud data; Analyzing the streaming media signaling to obtain at least two selectable quality indication information carried by the streaming media signaling; sending a data transmission request to the data source based on the quality indication information selected from the at least two kinds of quality indication information; receiving a point cloud file transmitted by the data source corresponding to the data transmission request.

9. 1. A computer implemented method for decoding a point cloud, comprising: receiving a point cloud file transmitted by a data source, the point cloud file including at least one point cloud media track; analyzing file encapsulation information of the at least one point cloud media track to obtain quality indication information carried by the file encapsulation information, the quality indication information being used to represent a point cloud quality of the at least one point cloud media track; selecting and decoding a point cloud media track from the point cloud file having a specified point cloud quality based on quality indication information carried by the file encapsulation information; The step of analyzing file encapsulation information of the at least one point cloud media track to obtain quality indication information carried by the file encapsulation information includes: determining at least one quality indication field relating to a quality parameter of the point cloud media track by analyzing file encapsulation information of the at least one point cloud media track; determining a quality indication for the point cloud file based on the value of the at least one quality indication field.

10. 1. A computer implemented method for encoding a point cloud, comprising: performing encoding processes on the point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams with the same point cloud content but different point cloud qualities; the point cloud bitstream includes at least one point cloud media track and encapsulates interchangeable groups corresponding to different point cloud media tracks; Point cloud media tracks having the same point cloud content but different point cloud qualities are placed in the same interchangeable group; When the point cloud bitstream is encapsulated in a single track, tracks of point cloud content with different qualities belong to the same interchangeable group; When the point cloud bitstream is encapsulated with multiple tracks, geometric component tracks of point cloud contents with different qualities belong to the same interchangeable group, and attribute component tracks are associated with the geometric component tracks; filling the point cloud bitstream with quality indication information according to the encoding standard, the quality indication information being used to represent the point cloud quality; encapsulating the point cloud bitstream as a point cloud media track; and filling the point cloud media track with quality indication information corresponding to the point cloud bitstream.

11. After the step of encapsulating the point cloud bitstream as a point cloud media track, the method further comprises: generating a stream media signaling used for transmitting the point cloud data; filling the stream media signaling with quality indication information corresponding to each of the point cloud bitstreams; The method of claim 10, further comprising: transmitting the stream media signaling to a data recipient.

12. After the step of transmitting the stream media signaling to a data recipient, the method further comprises: receiving a data transmission request generated based on the stream media signaling sent from the data receiving side; 12. The point cloud encoding method of claim 11, further comprising: transmitting a point cloud file to the data receiving side based on the data transmission request, the point cloud file including point cloud media tracks having the same point cloud content but different point cloud qualities.

13. The step of filling the point cloud bitstream with quality indication information used to represent the point cloud quality according to the encoding standard includes: determining a parameter value of a quality parameter of the point cloud bitstream according to the encoding standard, and determining a quality indication field in the point cloud bitstream corresponding to the quality parameter; determining quality indication information used to represent the point cloud quality based on the parameter values ​​of the quality parameters; and filling the quality indication field with the quality indication information based on a correspondence between the quality parameters and the quality indication field.

14. The step of filling the point cloud media track with quality indication information corresponding to the point cloud bitstream includes: determining a quality indication field in a file encapsulation information of the point cloud media track that corresponds to the quality indication information; and filling a quality indication field in the file encapsulation information with quality indication information corresponding to the point cloud bitstream.

15. A computer-implemented method for encoding a point cloud, comprising: performing encoding processes on the point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams with the same point cloud content but different point cloud qualities; filling the point cloud bitstream with quality indication information according to the encoding standard, the quality indication information being used to represent the point cloud quality; encapsulating the point cloud bitstream as a point cloud media track; filling the point cloud media track with quality indication information corresponding to the point cloud bitstream; After the step of encapsulating the point cloud bitstream as a point cloud media track, the method further comprises: generating a stream media signaling used for transmitting the point cloud data; filling the stream media signaling with quality indication information corresponding to each of the point cloud bitstreams; sending the stream media signaling to a data recipient; After the step of transmitting the stream media signaling to a data recipient, the method further comprises: receiving a data transmission request generated based on the stream media signaling sent from the data receiving side; and transmitting a point cloud file to the data receiving side based on the data transmission request, wherein the point cloud file includes point cloud media tracks having the same point cloud content but different point cloud qualities.

16. A computer-implemented method for encoding a point cloud, comprising: performing encoding processes on the point cloud data to be transmitted according to different encoding standards to obtain point cloud bitstreams with the same point cloud content but different point cloud qualities; filling the point cloud bitstream with quality indication information according to the encoding standard, the quality indication information being used to represent the point cloud quality; encapsulating the point cloud bitstream as a point cloud media track; filling the point cloud media track with quality indication information corresponding to the point cloud bitstream; The step of filling the point cloud bitstream with quality indication information used to represent the point cloud quality according to the encoding standard includes: determining a parameter value of a quality parameter of the point cloud bitstream according to the encoding standard, and determining a quality indication field in the point cloud bitstream corresponding to the quality parameter; determining quality indication information used to represent the point cloud quality based on the parameter values ​​of the quality parameters; and filling the quality indication field with the quality indication information based on a corresponding relationship between the quality parameters and the quality indication field.

17. A point cloud decoding device, comprising: A point cloud decoding device configured to perform the point cloud decoding method according to any one of claims 1 to 9.

18. A point cloud encoding device, comprising: A point cloud encoding device arranged to perform the point cloud encoding method according to any one of claims 10 to 16.

19. A computer program which, when executed by a processor, implements the method according to any one of claims 1 to 16.

20. An electronic device, A processor; a memory adapted to store executable instructions for said processor; 17. An electronic device, characterized in that the processor is configured to perform the method of any one of claims 1 to 16 by executing the executable instructions.

Images