Data processing method, apparatus, computer device, storage medium, and computer program

Abstract

A data processing method is provided, which includes the steps of: obtaining k component tracks and attra tiles corresponding to each component track, where the component tracks include component track data boxes, the component track data boxes include a tile number and spatial domain information, the tile number is the number of attra tiles corresponding to the component track to which the component track data boxes belong, the spatial domain information is the spatial domain of the component track to which the component track data boxes belong, and k is a positive integer (step S401); and encapsulating the k component tracks and the attra tiles corresponding to each component track according to the component track data boxes to obtain a target file (step S402).

Description

Technical Field

[0001] This invention claims priority based on a Chinese patent application with an application number of 2021107868087 filed on July 12, 2021, and an invention title of "Data Processing Method, Apparatus, Computer, and Readable Storage Medium", and incorporates all its content by reference into this invention.

[0002] This invention relates to the field of computer technology, and particularly to a data processing method, apparatus, computer, and readable storage medium.

Background Art

[0003] An immersive medium means media content that provides an immersive experience to users. A point cloud is a set of discrete points that irregularly disperse in space and represent the spatial structure and surface attributes of a three-dimensional object or scene. Generally, a point cloud is generated by a computer and can be acquired by means such as 3D laser scanning or 3D photogrammetry. With the evolution of point cloud acquisition means, a large amount of point cloud data can be obtained. With the accumulation of large-scale point cloud data, efficient storage, transmission, distribution, sharing, and standardization of point cloud data have become the key to the application of point clouds. Here, after encoding the point cloud data, it is necessary to encapsulate the encoded data stream and transmit it to the user. Currently, generally, the encoded data stream is directly encapsulated and the encapsulated data is transmitted to the user. In processes such as encoding and encapsulating point cloud data, some data is lost, and after receiving the encapsulated data, the user cannot perform a more accurate data acquisition process from the encapsulated data, and the efficiency and effect of data processing are relatively poor.

Summary of the Invention

[0004] Each embodiment of this invention provides a data processing method, apparatus, computer, and readable storage medium.

[0005] In one aspect of an embodiment of the present invention, there is provided a data processing method executed by a computer device, the method including: obtaining k component tracks and an atlas style corresponding to each component track, where the component track includes a component track data box, the component track data box includes the number of tiles and spatial region information, the number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, the spatial region information is the spatial region of the component track to which the component track data box belongs, and k is a positive integer; and encapsulating the k component tracks and the atlas style corresponding to each component track according to the component track data box to obtain a target file.

[0006] In one aspect of an embodiment of the present invention, there is provided a data processing method executed by a computer device, the method including: obtaining k component tracks in a target file, where the component track includes a component track data box, the component track data box includes the number of tiles and spatial region information, the number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, the spatial region information is the spatial region of the component track to which the component track data box belongs, and k is a positive integer; and decapsulating the target file according to the component track data box to obtain tile display content.

[0007] In one aspect of an embodiment of the present invention, there is provided a data processing apparatus including: a data acquisition module configured to acquire k component tracks and an atlas style corresponding to each component track, where each component track includes a component track data box, the component track data box includes the number of tiles and spatial region information, the number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, the spatial region information is the spatial region of the component track to which the component track data box belongs, and k is a positive integer; and a data encapsulation module configured to encapsulate the k component tracks and the atlas style corresponding to each component track according to the component track data box to obtain a target file.

[0008] In one aspect of an embodiment of the present invention, there is provided a data processing apparatus including: a track acquisition module configured to acquire k component tracks in a target file, where each component track includes a component track data box, the component track data box includes the number of tiles and spatial region information, the number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, the spatial region information is the spatial region of the component track to which the component track data box belongs, and k is a positive integer; and a data decapsulation module configured to decapsulate the target file according to the component track data box to obtain tile display content.

[0009] In one aspect of an embodiment of the present invention, there is provided a computer device including one or more processors, a memory, and an input / output interface, wherein the processor is respectively connected to the memory and the input / output interface, the input / output interface transmits and receives data, the memory stores computer-readable instructions, and the processor calls the computer-readable instructions to cause the computer device to execute the method described in the above aspect of the embodiment of the present invention.

[0010] In one aspect of an embodiment of the present invention, there is provided one or more computer-readable storage media storing computer-readable instructions, wherein the computer-readable instructions are loaded and executed by a processor to cause a computer device having one or more processors to execute the method described in the above aspect of the embodiment of the present invention.

[0011] In one aspect of an embodiment of the present invention, there is provided a computer program product including computer-readable instructions, wherein the computer-readable instructions, when executed by one or more processors, implement the steps of the method described in the above aspect of the embodiment of the present invention.

[0012] Details of one or more embodiments of the present invention are presented in the following drawings and description. Other features, objects, and advantages of the present invention will become apparent from the specification, drawings, and claims.

Brief Description of the Drawings

[0013] To more clearly illustrate the technology according to embodiments of the present invention, the following briefly introduces the drawings necessary for the description of the embodiments. It should be noted that the drawings in the following description are merely some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without creative work.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Mode for Carrying Out the Invention

[0014] The following clearly and completely describes the technology in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. However, the described embodiments are only a part of the embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative labor are within the scope of the present invention.

[0015] Embodiments of the present invention relate to a data processing technology, which is a technology for data encapsulation and decapsulation for an atlas. Here, the atlas indicates region information in a 2D plane frame, region information in a 3D representation space, a mapping relationship between the two, and parameter information required for mapping. The atlas may mean an atlas corresponding to a volumetric video. The volumetric video is an immersive medium that is captured from three-dimensional spatial visual content (content) and includes a volumetric video type track in a file package, and provides a viewing experience such as 3 Degree of Freedom+ (3DoF+) or 6 Degree of Freedom (6DoF), and includes multi-view video and video encoded point cloud, etc. Here, the multi-view / multi-point video is a video that employs a plurality of sets of camera arrays and has depth information captured from multiple angles. The multi-view / multi-point video is also referred to as a free-view / free-point video and is an immersive medium that provides a 6DoF experience. A point cloud is a set of discrete points that represents the spatial structure and surface attributes of a three-dimensional object or scene that is irregularly distributed in space. Each point in the point cloud has at least three-dimensional position information and may have color, material, or other information, etc., depending on the application scene. Usually, each point in the point cloud has the same number of additional attributes.

[0016] Also, the Degree of Freedom (DoF) is the degree of freedom that supports movement and creates content interaction when a user views an immersive medium. 3DoF refers to three degrees of freedom in which the user's head rotates around the coordinate axes (x-axis, y-axis, z-axis) of a three-dimensional space. 3DoF+ means having, in addition to three degrees of freedom, degrees of freedom of finite movement along the x-axis, y-axis, and z-axis. 6DoF means having, in addition to three degrees of freedom, degrees of freedom of free movement along the x-axis, y-axis, and z-axis.

[0017] Preferably, the present invention is applicable to encapsulation and decapsulation of volumetric video such as multi-view / multi-point video and point cloud compression (Video-based Point Cloud Compression: V-PCC) point cloud media based on conventional video coding.

[0018] Specifically, it will be described with reference to FIG. 1. FIG. 1 is an architecture diagram of data processing according to an embodiment of the present invention. As shown in FIG. 1, the embodiment of the present invention is realized by a computer device 101, and the computer device 101 may be composed of a server and a terminal device. The computer device 101 may be a server or a terminal device, and is not limited thereto.

[0019] For example, computer device 101 may acquire data of volumetric video, the data includes an atlas corresponding to the volumetric video, the atlas consists of N atlas tiles, and N is a positive integer. Preferably, computer device 101 may acquire one or at least two volumetric videos. One volumetric video may correspond to one atlas, or one volumetric video may correspond to at least two atlases, or at least two volumetric videos may correspond to one atlas. Preferably, when one volumetric video corresponds to at least two atlases, computer device 101 may add an atlas ID for each atlas, and based on the atlas ID, determine the volumetric video to which the atlas belongs. Specifically, computer device 101 may acquire k component tracks that require encapsulation and atlas tiles corresponding to each component track. Here, the component track includes a component track data box. Computer device 101 may encapsulate the k component tracks and the atlas tiles corresponding to each component track based on the component track data boxes included in each of the k component tracks, and acquire a target file, where k is a positive integer. Computer device 101 may send the target file to a user device such as user device 102a, user device 102b, or user device 102c. Specifically, computer device 101 may receive a file acquisition request from the user device for the target file, and based on the file acquisition request, send the target file to the user device.Alternatively, the computer device 101 may obtain a data acquisition request of the user device for the volumetric video, and based on the data acquisition request, obtain k component tracks related to the volumetric video and an atlas style corresponding to each component track, and encapsulate the k component tracks and the atlas style corresponding to each component track based on the component track data boxes included in each component track, and obtain a target file. Alternatively, the computer device 101 may obtain an atlas corresponding to the volumetric video, perform tiling processing on the atlas, obtain the atlas style included in the atlas, and when performing tiling processing on the atlas, obtain the component tracks related to each atlas style based on the video information of the volumetric video, and obtain k component tracks and the atlas style corresponding to each component track based on the association relationship between the component tracks and the atlas style.

[0020] In other words, when the computer device 101 receives an acquisition request for target data, it acquires k component tracks associated with the target data and an atlas style corresponding to each component track, encapsulates the k component tracks and the atlas style corresponding to each component track based on the component track data boxes included in each of the k component tracks, acquires a target file, and may transmit the target file to the user device that made the acquisition request for the target data. Here, the target data may be a target file, and in this case, the target file may be generated in advance. The target data may be volumetric video, and in this case, the target file may be generated in advance or may be generated after receiving an acquisition request for the target data. The target data may be a component track, that is, the target data includes k component tracks, and the computer device may acquire an atlas style corresponding to the target data, etc., but is not limited thereto.

[0021] Preferably, the data of the present invention may be stored in a computer device or may be stored based on blockchain technology or cloud storage technology, etc. That is, the data of the present invention may be stored in a blockchain network or a cloud space, etc., but is not limited thereto. For example, the computer device 101 may store k component tracks and an atlas style corresponding to each component track, as well as component-related information of each component track, a target file obtained by encapsulating the k component tracks and the atlas style corresponding to each component track, etc. in one or more (at least two) locations in the computer device 101, a blockchain network, or a cloud space, etc. The computer device 101 may store the data of the present invention in one location to save resources. Also, in order to ensure the security of the data, it may be stored in multiple locations.

[0022] In an embodiment of the present invention, by encapsulating a component track data box for displaying component-related information of a corresponding component track in each component track, all component-related information of each component track can be obtained, and the information of the component track can be retained as comprehensively as possible. In order to further organize and refine the information of the component track in the encapsulated target file, the user device that receives the target file can decapsulate and obtain the required component track based on the component track data box of each component track, and can save the time and resources related to data processing.

[0023] Next, an explanation will be given with reference to FIG. 2. FIG. 2 is a schematic diagram of a scenario for generating a component track according to an embodiment of the present invention. As shown in FIG. 2, taking as an example that one volumetric video corresponds to one atlas, the embodiments of the present invention are implemented by a computer device. The computer device acquires the volumetric video 201, performs analysis and information extraction on the volumetric video 201, acquires the atlas 202 of the volumetric video 201, performs an atlas style on the atlas 202 of the volumetric video 201, and acquires N atlas styles 203 corresponding to the atlas 202. Specifically, an atlas style may be performed on the atlas 202 of the volumetric video 201 for each region. Based on the volumetric video 201, a component track corresponding to each of the N atlas styles 203 is acquired, and based on the relationship between the atlas style and the component track, an atlas track 204 is acquired. Specifically, the computer device acquires a component track corresponding to each of the N atlas styles 203. Specifically, the tile information of each atlas style is acquired, and based on the tile information type corresponding to the tile information, the component track type corresponding to each of the atlas styles is determined, and based on the component track type corresponding to each of the atlas styles, the component track corresponding to each of the atlas styles may be acquired. For example, when the tile information type corresponding to the tile information is a color information type, the computer device may determine the component track type corresponding to the atlas style related to the tile information as an attribute component type. When the tile information type corresponding to the tile information is a position information type, the computer device may determine the component track type corresponding to the atlas style related to the tile information as a geometric component type or the like. Here, the atlas track 204 may be a track including a group of component tracks, that is, the atlas track 204 may include at least two component tracks and an atlas style corresponding to each component track respectively.Here, one atlas style may correspond to one component track, or may correspond to at least two component tracks, and one component track may correspond to at least two atlas styles, but is not limited thereto. Preferably, when the computer device generates a target file corresponding to volumetric video, the number of the at least two component tracks is k.

[0024] Next, a description will be given with reference to FIG. 3. FIG. 3 is a schematic diagram of a data processing scenario according to an embodiment of the present invention. As shown in FIG. 3, the computer device 301 may obtain component-related information 302 corresponding to k component tracks respectively. The component-related information 302 includes k component tracks and atlas styles respectively corresponding to each component track, for example, the component track 1 and the atlas style corresponding to the component track 1, the component track 2 and the atlas style corresponding to the component track 2, and the component track k and the atlas style corresponding to the component track k, and the like. Here, each component track includes a component track data box. The computer device 301 may encapsulate k component tracks and the component-related information 302 of each component track, obtain a target file, and transmit the target file to the user device 303. The user device 303 may obtain necessary component tracks from the target file, decapsulate the component-related information of the component tracks, and obtain tile display content 304. Further, the user device 303 may display the tile display content 304.

[0025] Note that the computer device includes a terminal device or a server, and may be a user terminal (User Equipment: UE), but is not limited thereto. The user device may include a terminal device or a server, but is not limited thereto. In other words, the computer device may be a server or a terminal device, or may be a system consisting of a server and a terminal device. Here, the above-mentioned terminal device may be an electronic device, and the electronic device may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, an in-vehicle device, an augmented reality / virtual reality (AR / VR) device, a head-mounted display, a smart TV, a wearable device, a smart speaker, a digital camera, a camera, and other mobile internet devices (MIDs) having a network access function, or a terminal device in scenarios such as trains, ships, airplanes, etc., but is not limited thereto. Here, the above-mentioned server may be an independent physical server, or may be a server cluster or a distributed system composed of multiple physical servers, or may be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, vehicle-road cooperation, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0026] Here, "or" in this specification means any one or more of a plurality of things. For example, "A or B" means "A", "B", and "A and B".

[0027] Next, an explanation will be given with reference to FIG. 4. FIG. 4 is a flowchart of a data encapsulation method according to an embodiment of the present invention. As shown in FIG. 4, the data encapsulation method includes the following steps.

[0028] Step S401: Obtain k component tracks and an atlas style corresponding to each component track.

[0029] Specifically, each component track includes a component track data box, and the component track data box includes the number of tiles (which may be denoted as num_tiles) and spatial region information (which may be denoted as 3D_spatial_region_flag). Here, the number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, the spatial region information is the spatial region of the component track to which the component track data box belongs, and k is a positive integer. Preferably, the component track data box may further include an atlas ID, an atlas style ID, and the like.

[0030] Preferably, there may be one or at least two track group classification informations, and each track group classification information corresponds to one track group classification method. Here, the track group classification information may be changed as needed. For example, the track group classification information may be added or the track group classification information may be deleted.

[0031] In one track group classification method, the atlas styles corresponding to each component track include a first atlas style and a second atlas style, that is, the first atlas style included in the first component track and the second atlas style included in the second component track. When the atlas ID associated with the first atlas style ID of the first atlas style is the same as the atlas ID associated with the second atlas style ID of the second atlas style, the first atlas style and the second atlas style belong to the same tile track group, that is, the first component track corresponding to the first atlas style and the second component track corresponding to the second atlas style may be added to the same tile track group. In this case, each tile track group indicates the information of the component tracks corresponding to one atlas, that is, the atlas styles corresponding to the component tracks in one tile track group may be regarded as belonging to the same atlas.

[0032] In one track group classification method, the component track further includes a component track type. Assuming that k component tracks include a first component track and a second component track, when the first component track type of the first component track is the same as the second component track type of the second component track, and the atlas ID associated with the atlas style corresponding to the first component track is the same as the atlas ID associated with the atlas style corresponding to the second component track, the atlas style corresponding to the first component track and the atlas style corresponding to the second component track belong to the same tile track group. In other words, the component track types of the component tracks included in the same tile track group are the same, and the atlas styles corresponding to the component tracks belong to the same atlas.

[0033] Here, the component track data box includes a track group data box, the track group data box includes an atlas ID and an atlas style ID, and the atlas ID indicates the ID of the atlas to which the atlas style belongs. Preferably, when the atlas style ID is related to the atlas ID, the atlas style corresponding to the atlas style ID belongs to the atlas corresponding to the atlas ID. Here, the track group data box may further include the number of tiles, spatial region information, and the like.

[0034] Preferably, the component track data box may include a component information data box, the component information data box may include a data box type, and the data box type indicates information on the component track to which the component information data box belongs as indicated by the component information data box. The k component tracks include a target component track. Specifically, the component information data box may include a data box type, the parent data box to which the component information data box belongs (such as a data box named SchemeInformationBox), an execution state (including a forced execution state and an optional execution state), and the number of data boxes. The component information data box may further include the number of tiles, spatial region information, and an atlas ID. When encapsulating the component information data box in the target component track, the component information data box indicates the atlas style and spatial information corresponding to the target component track.

[0035] Preferably, the component track data box may include one or at least two of the track group data box or the component information data box. Here, the positions of the track group data box and the component information data box in the component track are different.

[0036] For example, a description will be given with reference to FIG. 5. FIG. 5 is a schematic diagram of a track group classification according to an embodiment of the present invention. As shown in FIG. 5, the computer device acquires k component tracks and atlas styles corresponding to each component track, for example, component track 1 (denoted as track11), component track 2 (denoted as track12), component track 3 (denoted as track13), and component track 4 (denoted as track14). Here, the component track type corresponding to track11 is a geometric component type and corresponds to atlas style 1 (denoted as tile1), the component track type corresponding to track12 is a geometric component type and corresponds to atlas style 2 (denoted as tile2), the component track type corresponding to track13 is an attribute component type and corresponds to atlas style 3 (denoted as tile3), and the component track type corresponding to track14 is an attribute component type and corresponds to atlas style 4 (denoted as tile4). Preferably, the component track type may include, but is not limited to, a placeholder component type, a geometric component type, an attribute component type, a package component type, etc.

[0037] Step S402: According to the component track data boxes included in the component tracks, encapsulate the k component tracks and the atlas styles corresponding to each component track, and obtain a target file.

[0038] Specifically, the computer device may obtain track group classification information, and based on the track group classification information, obtain component track information from the component track data boxes included in each of the k component tracks. The track group classification information indicates a method for grouping the k component tracks. For example, when the track group classification information indicates a track group classification method based on an atlas, the component track information obtained by the computer device may include the atlas to which the atlas style corresponding to each of the k component tracks belongs. When the track group classification information indicates a track group classification method based on an atlas and a component track type, the component track information obtained by the computer device may include the atlas to which the atlas style corresponding to each of the k component tracks belongs, and the component track type of each component track, etc. Based on the track group classification information and the component track information, the k component tracks are classified to obtain M tile track groups. M is a positive integer. The M tile track groups and the atlas styles related to each tile track group are encapsulated to obtain a target file.

[0039] Specifically, in one track group classification method, the track group classification information includes atlas classification information, and the component track information of the k component tracks includes the atlas ID related to the atlas style corresponding to each of the k component tracks. The atlas ID indicates the ID of the atlas to which the atlas style belongs. When classifying the k component tracks based on the track group classification information and the component track information to obtain M tile track groups, the computer device may group the component tracks corresponding to the atlas style related to the same atlas ID based on the atlas classification information among the k component tracks to obtain M tile track groups.

[0040] In one method for dividing track groups, the track group division information includes atlas component division information, and the component track information of k component tracks includes an atlas ID related to the atlas style corresponding to each of the k component tracks, and a component track type corresponding to each of the k component tracks. The atlas ID indicates the ID of the atlas to which the atlas style belongs. When dividing k component tracks based on the track group division information and the component track information to obtain M tile track groups, the computer device may group, in the k component tracks, the component tracks having the same component track type and related to the same atlas ID based on the atlas component division information, and obtain M tile track groups.

[0041] Preferably, the computer device may determine a component track type corresponding to each of the k component tracks and an atlas ID to which the atlas style to which each of the k component tracks belongs based on the component track information. The atlas ID indicates the ID of the atlas of the volumetric video to which the atlas style belongs. If there is a component track to be divided into k component tracks, the component track to be divided is divided into at least two component sub-tracks based on the atlas ID to which the atlas style to which the component track to be divided belongs. The component track to be divided is a component track corresponding to at least two atlas styles and having different atlas IDs corresponding to each of the at least two atlas styles, and the component tiles corresponding to the same component sub-track are related to the same atlas ID. For example, if there are atlas style 1 and atlas style 2 corresponding to component track A, where atlas style 1 corresponds to atlas ID1 and atlas style 2 corresponds to atlas ID2, then component track A is determined as the component track to be divided, and the component track to be divided is divided into at least two component sub-tracks. The at least two component sub-tracks include component sub-track 1 (corresponding to atlas style 1) and component sub-track 2 (corresponding to atlas style 2). Next, at least two component sub-tracks and normal component tracks are determined as candidate component tracks. The normal component track is a component track other than the component track to be divided among the k component tracks. Candidate component tracks having the same component track type and related to the same atlas ID are divided to obtain M tile track groups.

[0042] Here, obtain the track index i of the component track type information corresponding to the i-th tile track group among the M tile track groups. i is a positive integer not exceeding M. Add the track index i for the i-th tile track group, and based on the track index i, associate the i-th tile track group with the atlas style corresponding to the component tracks included in the i-th tile track group. Based on the association result, encapsulate the M tile track groups and the atlas styles related to each tile track group, and obtain the target file. Here, the track index may be represented by a character string, and the character string may be generated based on the generation order of the track index, that is, it may represent the generation order of the track index, or it may be a unique index generated randomly, or it may be determined based on the data type of the component track, but is not limited thereto.

[0043] For example, the track index may refer to that shown in Table 1.

[0044] [Table 1] As shown in Table 1, the track index includes, but is not limited to, v3vo, v3vg, v3va, v3vp, etc., and the component track type of the component tracks included in the corresponding tile track group may be represented by the track index. Here, when determining the tile track group based on the component track type, the component track types of the component tracks included in each tile track group are the same, and the component track types of the component tracks included in the tile track group may be represented based on the track index. Thereby, the amount of data to be processed can be reduced. For example, when Component Track 1 to Component Track 10 are all of the geometric component track type, the computer device may classify Component Track 1 to Component Track 10 into one tile track group and label the tile track group based on the track index "v3vg". Thereby, it is not necessary to have a component track type for each component track, and the amount of data to be processed can be reduced.

[0045] For example, as shown in FIG. 5, when both component track 1 (track11) and component track 2 (track12) correspond to geometric component types, and both component track 3 (track13) and component track 4 (track14) correspond to attribute component types, the computer device may arrange track11 and track12 in one track group, i.e., tile track group 1, and track13 and track14 in one track group, i.e., tile track group 2, based on the component track types. Preferably, based on Table 1, tile track group 1 may be labeled using the track index "v3vg", the atlas styles corresponding to track11 and track12 respectively may be associated with tile track group 1, and tile track group 1 may be associated with an atlas track (see FIG. 2). Tile track group 2 may be labeled using the track index "v3va", the atlas styles corresponding to track13 and track14 respectively may be associated with tile track group 2, and tile track group 2 may be associated with an atlas track (see FIG. 2).

[0046] Embodiments of the present invention obtain k component tracks and an atlas style corresponding to each component track. The component track includes a component track data box. The component track data box includes the number of tiles and spatial region information. The number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs. The spatial region information is the spatial region of the component track to which the component track data box belongs. k is a positive integer. According to the component track data box, k component tracks and the atlas style corresponding to each component track are encapsulated to obtain a target file. According to the above process, one component track data box can be encapsulated for each component track, and the component track data box indicates the related information of the component track where it is located. The related relationships such as atlas style information and component tracks (i.e., component tiles and component tracks) can be refined to the granularity of a single component track, and the information of the component track can be retained as comprehensively as possible. The information of the component track in the target file obtained by encapsulation can be made more orderly and refined. Further, after the target file is sent to the user device, the user device can accurately select the required component track and achieve the purpose of partial decapsulation and partial decoding. Therefore, it is not necessary to perform full decapsulation and decoding on the target file, saving the time and resources for data processing and improving the accuracy and efficiency of data processing.

[0047] Next, it will be described with reference to FIG. 6. FIG. 6 is a flowchart of a data decapsulation method according to an embodiment of the present invention. As shown in FIG. 6, the method includes the following steps.

[0048] Step S601: Obtain k component tracks in the target file, where the component tracks include component track data boxes.

[0049] Specifically, the component track data box includes the number of tiles and spatial region information. The number of tiles is the number of atlas tiles corresponding to the component track to which the component track data box belongs, and the spatial region information is the spatial region of the component track to which the component track data box belongs. k is a positive integer.

[0050] Step S602: Decapsulate the target file according to the component track data box to obtain tile display content.

[0051] Specifically, when responding to a display request for a target component track, the computer device obtains the target component track data box included in the target component track from the target file, and obtains the number of target tiles corresponding to the target component track from the target component track data box. Here, the position of the component track in the target component track data box is known, and the computer device may obtain the data box position and obtain the target component track data box at the data box position in the target component track. Preferably, the target component track data box may be a track group data box, an assembly information data box, or may include a track group data box and a component information data box. When the computer device determines the target component track data box included in the target track component and obtains the target data box position of the target component track data box, the computer device obtains the target component track data box at the target data box position in the target component track. When the computer device has not obtained the components of the target component track data box, or when the target component track data box includes a track group data box and a component information data box, the computer device obtains the first data box position corresponding to the track group data box and the second data box position corresponding to the component information data box, performs a search at the first data box position and the second data box position of the target component track, and may perform subsequent processing based on the discovered data box. In other words, the track group data box and the component information data box may be mutually substitutable and may substantially represent the same information. Here, the target component track may be any one of the k component tracks.

[0052] Next, the computer device may perform h iterative decapsulations on the target file based on the number of target tiles, and obtain tile display contents corresponding to the target component track. h is the number of the target tiles. In other words, the target component track corresponds to h atlas tiles, performs h iterative decapsulations on the target component track in the target file, and obtains atlas tile information corresponding to each of the h atlas tiles.

[0053] When responding to a display request for an atlas style to be processed, obtain the atlas style ID of the atlas style to be processed. Obtain the component track data boxes included in each of the k component tracks from the target file, and perform a scanning search on the component track data boxes included in each of the k component tracks based on the number of tiles in the component track data box and the atlas style ID to be processed. Specifically, the component track corresponds to h atlas styles, that is, the component track data box included in the component track includes the atlas style IDs of the h atlas styles corresponding to the component track, and the computer device scans and searches for the atlas style IDs in the component track data boxes included in each of the k component tracks based on the number of tiles h. If the atlas style ID to be processed has not been obtained after h searches, it means that the atlas style ID to be processed does not exist in the currently searched component track. Next, determine the component track to which the component track data box in which the atlas style ID to be processed is found belongs as the component track to be processed, perform a decapsulation process on the component track to be processed, and obtain the tile display content corresponding to the atlas style to be processed. As shown in FIG. 5, when the atlas style to be processed is tile1, the computer device performs a scanning search on the component track data boxes included in each of the k component tracks, and obtains the component tracks to be processed including component track 1 and component track 3.

[0054] Also preferably, the computer device decapsulates the target file according to the component track data box, obtains k component tracks and the atlas style corresponding to each component track, determines the spatial region where the k component tracks in the volumetric video are located based on the spatial region information in the component track data box included in each of the k component tracks, and generates tile display content based on the spatial region where the k component tracks in the volumetric video are located and the atlas style corresponding to each component track.

[0055] Preferably, when responding to a display request for a target component track, the computer device obtains the target track component from the target file, performs a decapsulation process on the target track component according to the target component track data box included in the target track component, and may obtain the encoded bitstream corresponding to the target track component. Also, the encoded bitstream may be decoded to generate a decoded signal corresponding to the encoded bitstream. Also, atlas style data corresponding to the target component track may be obtained, and point cloud information of the atlas style corresponding to the target component track may be determined based on the atlas style data. Based on the point cloud information, the tile display content corresponding to the target component track may be determined.

[0056] Embodiments of the present invention obtain k component tracks and an atlas style corresponding to each component track. The component track includes a component track data box, and the component track data box includes the number of tiles and spatial region information. The number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, and the spatial region information is the spatial region of the component track to which the component track data box belongs. k is a positive integer. According to the component track data box, k component tracks and the atlas style corresponding to each component track are encapsulated to obtain a target file. According to the above process, one component track data box can be encapsulated for each component track, and the component track data box indicates the related information of the component track where it is located. The related relationships such as atlas style information and component tracks (i.e., component tiles and component tracks) can be refined to the granularity of a single component track, and the information of the component track can be retained as comprehensively as possible. The information of the component track in the target file obtained by encapsulation can be made more orderly and refined. Also, after transmitting the target file to the user device, the user device can accurately select the required component track and achieve the purpose of partial decapsulation and partial decoding. Therefore, it is not necessary to perform full decapsulation and decoding on the target file, saving the time and resources for data processing and improving the accuracy and efficiency of data processing.

[0057] Next, an explanation will be given with reference to FIG. 7. FIG. 7 is a schematic diagram of a data processing scenario according to an embodiment of the present invention. As shown in FIG. 7, the real world or synthetic visual scene (A) is captured by a group of cameras or virtual cameras having a plurality of lenses and sensors. The real world or synthetic visual scene (A) may mean a volumetric video or the like. The collection result of the computer device is the source volumetric data (B). The source volumetric data is encoded to obtain an encoded V3C bitstream (Ev) including one atlas bitstream, at most one occupancy bitstream, one geometric bitstream, and zero or at least one attribute bitstream. Next, the computer device may encapsulate one or more encoded V3C bitstreams into a file / segment according to a specific media container file format to obtain a media file (F) for local playback, or a sequence of an initialization segment and media segments (Fs) for streaming transmission. Here, the media container file format may be the ISO base media file format defined in ISO / IEC 14496-12. The sequence of the initialization segment and media segments (Fs) may be transmitted to the user device based on a distribution mechanism.

[0058] Also, the media file (F) output by the file encapsulation device is the same as the file (F’) that is the input of the file decapsulation device. The file decapsulation device may process the file (F’) or the received segment (Fs’), that is, process the file (F’) or the received segment (Fs’) to perform file / segment decapsulation, extract the encoded bitstream (Ev’), and may decode the encoded bitstream to obtain a decoded signal (D’). Based on the current viewing direction or viewport, the decoded signal (D’) is reconstructed to obtain reconstruction information (B’), the reconstruction information (B’) is rendered to obtain tile display content (A’), and the tile display content (A’) is displayed on the user device, for example, on the screen of a head-mounted display or other arbitrary display device. Preferably, the current viewing direction is determined by a head tracking or eye tracking function. Preferably, the computer device may pass the current viewing direction to a policy module and determine the trajectory to be received based on the policy module.

[0059] Here, when performing file / segment encapsulation on one or more encoded V3C bitstreams, the steps shown in FIG. 4 of this specification are used to perform encapsulation processing on one or more encoded V3C bitstreams, and a target file including a media file (F) or a sequence of an initialization segment and media segments (Fs) may be obtained. When performing file / segment decapsulation on the processing file (F’) or the received segment (Fs’), the steps in FIG. 6 are used to perform file / segment decapsulation on the processing file (F’) or the received segment (Fs’) to obtain tile display content.

[0060] FIG. 8 is a schematic diagram of a data processing apparatus according to an embodiment of the present invention. The above-described data processing apparatus may be computer-readable instructions (including program code) executed within a computer device. For example, the data processing apparatus may be application software. The apparatus may be used to execute corresponding steps of the method according to an embodiment of the present invention. As shown in FIG. 8, the data processing apparatus 800 may be applied to the computer device of the embodiment corresponding to FIG. 4 described above. Specifically, the apparatus may include a data acquisition module 11 and a data encapsulation module 12.

[0061] The data acquisition module 11 acquires k component tracks and an atlas style corresponding to each component track. A component track includes a component track data box. The component track data box includes the number of tiles and spatial region information. The number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs. The spatial region information is the spatial region of the component track to which the component track data box belongs. k is a positive integer.

[0062] The data encapsulation module 12 encapsulates k component tracks and an atlas style corresponding to each component track according to the component track data box to obtain a target file.

[0063] Here, the component track data box includes a track group data box. The track group data box includes an atlas ID and an atlas style ID. The atlas ID indicates the ID of the atlas to which the atlas style belongs.

[0064] When the atlas style ID is related to the atlas ID, the atlas style corresponding to the atlas style ID belongs to the atlas of the volumetric video corresponding to the atlas ID.

[0065] Here, the component track data box includes a track group data box, the track group data box includes an atlas ID and an atlas style ID, the atlas ID indicates the ID of the atlas to which the atlas style belongs, and the atlas styles corresponding to each component track include a first atlas style and a second atlas style.

[0066] If the atlas ID associated with the first atlas style ID of the first atlas style is the same as the atlas ID associated with the second atlas style ID of the second atlas style, the first atlas style and the second atlas style belong to the same tile track group, and the atlas styles corresponding to the component tracks in the same tile track group belong to the same atlas.

[0067] Here, the component track further includes a component track type, and k component tracks include a first component track and a second component track.

[0068] If the first component track type of the first component track is the same as the second component track type of the second component track, the atlas style corresponding to the first component track and the atlas style corresponding to the second component track belong to the same tile track group.

[0069] Here, the component track data box includes a component information data box, the component information data box includes a data box type, the data box type indicates the information of the component track to which the component information data box belongs as indicated by the component information data box, and k component tracks include a target component track.

[0070] When encapsulating a component information data box into a target component track, the component information data box includes an atlas style and spatial region information corresponding to the target component track.

[0071] Here, the data encapsulation module 12 includes the following units.

[0072] The information acquisition unit 121 acquires track group classification information, and based on the track group classification information, acquires component track information of k component tracks from the component track data boxes included in each of the k component tracks. The track group classification information indicates a method of grouping k component tracks.

[0073] The track group division unit 122 divides k component tracks based on the track group classification information and the component track information, and acquires M tile track groups. M is a positive integer.

[0074] The track encapsulation unit 123 encapsulates M tile track groups and the atlas style related to each tile track group, and acquires a target file.

[0075] Here, the track group classification information includes atlas classification information, the component track information of k component tracks includes an atlas ID related to the atlas style corresponding to each of the k component tracks, and the atlas ID indicates the ID of the atlas to which the atlas style belongs.

[0076] The track group division unit 122 includes the following units.

[0077] The Atlas group division subunit 1221 groups component tracks corresponding to an Atlas style related to the same Atlas ID in k component tracks based on the Atlas classification information, and obtains M tile track groups.

[0078] Here, the track group classification information includes Atlas component classification information, and the component track information of the k component tracks includes the Atlas ID related to the Atlas style corresponding to each of the k component tracks, and the component track type corresponding to each of the k component tracks. The Atlas ID indicates the ID of the Atlas to which the Atlas style belongs.

[0079] The track group division unit 122 includes the following units.

[0080] The type group division subunit 1222 groups component tracks having the same component track type and related to the same Atlas ID in k component tracks based on the Atlas component classification information, and obtains M tile track groups.

[0081] Here, the track group division unit 122 includes the following units.

[0082] The type determination subunit 1223 determines the component track type corresponding to each of the k component tracks and the Atlas ID to which the Atlas style corresponding to each of the k component tracks belongs based on the component track information. The Atlas ID indicates the ID of the Atlas of the volumetric video to which the Atlas style belongs.

[0083] When there is a component track to be divided into k component tracks, the track division subunit 1224 divides the component track to be divided into at least two component sub-tracks based on the atlas ID to which the atlas style corresponding to the component track to be divided belongs. The component track to be divided is a component track corresponding to at least two atlas styles and having different atlas IDs corresponding to each of the at least two atlas styles, and the component tiles corresponding to the same component sub-track are related to the same atlas ID.

[0084] The track determination subunit 1225 determines at least two component sub-tracks and a normal component track as candidate component tracks. The normal component track is a component track other than the component track to be divided among the k component tracks.

[0085] The track grouping subunit 1226 classifies candidate component tracks having the same component track type and related to the same atlas ID, and obtains M tile track groups.

[0086] Here, the track encapsulation unit 123 includes the following units.

[0087] The index acquisition subunit 1231 acquires the track index i of the component track type information corresponding to the i-th tile track group among the M tile track groups. i is a positive integer not exceeding M.

[0088] The index association subunit 1232 adds the track index i for the i-th tile track group, and based on the track index i, associates the i-th tile track group with the atlas style corresponding to the component track included in the i-th tile track group.

[0089] The file generation subunit 1233 encapsulates M tile track groups and the atlas styles associated with each tile track group based on the association result, and obtains a target file.

[0090] The data processing apparatus according to an embodiment of the present invention obtains k component tracks and the atlas styles corresponding to each component track. The component track includes a component track data box. The component track data box includes the number of tiles and spatial region information. The number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, and the spatial region information is the spatial region of the component track to which the component track data box belongs. k is a positive integer. According to the component track data box, k component tracks and the atlas styles corresponding to each component track are encapsulated, and a target file is obtained. According to the above process, one component track data box can be encapsulated for each component track, and the component track data box indicates the related information of the component track where it is located. The related relationships such as atlas style information and component tracks (i.e., component tiles and component tracks) can be refined to the granularity of a single component track, and the information of the component track can be retained as comprehensively as possible. The information of the component track in the target file obtained by encapsulation can be made more orderly and refined. Further, after the target file is transmitted to the user device, the user device can accurately select the required component track and achieve the purpose of partial decapsulation and partial decoding. Therefore, it is not necessary to perform overall decapsulation and decoding on the target file, saving the time and resources required for data processing and improving the accuracy and efficiency of data processing.

[0091] A description will be given with reference to FIG. 9. FIG. 9 is a schematic diagram of another data processing apparatus according to an embodiment of the present invention. The above-described data processing apparatus may be computer-readable instructions (including program code) executed within a computer device. For example, the data processing apparatus may be application software. The apparatus may be used to execute corresponding steps of the method according to an embodiment of the present invention. As shown in FIG. 9, the data processing apparatus 900 may be applied to the computer device of the embodiment corresponding to FIG. 6 described above. Specifically, the apparatus may include a track acquisition module 21 and a data decapsulation module 22.

[0092] The track acquisition module 21 acquires k component tracks in a target file. The component track includes a component track data box. The component track data box includes the number of tiles and spatial region information. The number of tiles is the number of atlas tiles corresponding to the component track to which the component track data box belongs. The spatial region information is the spatial region of the component track to which the component track data box belongs. k is a positive integer.

[0093] The data decapsulation module 22 decapsulates the target file according to the component track data box and acquires tile display content.

[0094] Here, the data decapsulation module 22 includes the following units.

[0095] When responding to a display request for a target component track, the number acquisition unit 221 acquires the target component track data box included in the target component track from the target file, and acquires the target tile number corresponding to the target component track from the target component track data box.

[0096] The decapsulation iteration unit 222 performs h iterative decapsulations on the target file based on the number of target tiles, and obtains the tile display content corresponding to the target component track. h is the number of target tiles.

[0097] Here, the data decapsulation module 22 includes the following units.

[0098] When responding to the display request for the atlas tile to be processed, the ID acquisition unit 223 acquires the atlas tile ID of the atlas tile to be processed.

[0099] The data box search unit 224 acquires the component track data boxes included in each of the k component tracks from the target file, and performs a scanning search on the component track data boxes included in each of the k component tracks based on the number of tiles in the component track data box and the atlas tile ID to be processed.

[0100] The track selection unit 225 determines the component track to which the component track data box in which the atlas tile ID to be processed is found belongs as the component track to be processed.

[0101] The track decapsulation unit 226 performs decapsulation processing on the component track to be processed, and obtains the tile display content corresponding to the atlas tile to be processed.

[0102] Here, the data decapsulation module 22 includes the following units.

[0103] The file decapsulation unit 227 decapsulates the target file according to the component track data box, and acquires k component tracks and the atlas tiles corresponding to each component track.

[0104] Based on the spatial region information in the component track data box included in each of the k component tracks, the space determination unit 228 determines the spatial region where the k component tracks in the volumetric video are located.

[0105] Based on the spatial region where the k component tracks in the volumetric video are located and the atlas style corresponding to each component track, the content generation unit 229 generates tile display content.

[0106] The data processing apparatus according to an embodiment of the present invention acquires k component tracks in a target file. The component track includes a component track data box. The component track data box includes the number of tiles and spatial region information. The number of tiles is the number of atlas tiles corresponding to the component track to which the component track data box belongs. The spatial region information is the spatial region of the component track to which the component track data box belongs. k is a positive integer. The target file is decapsulated according to the component track data box to obtain tile display content. According to the above process, one component track data box can be encapsulated for each component track, and the component track data box indicates the related information of the component track where it is located. The related relationships such as atlas tile information and component tracks (i.e., component tiles and component tracks) can be refined to the granularity of a single component track. After receiving the target file, the user device can obtain the information of each component track based on the component track data box of each component track at the granularity of a single component track. The user device can perform operations such as decapsulation and decoding on the necessary parts in the target file as needed, and can save the time and resources for data processing, so as to improve the accuracy and efficiency of data processing.

[0107] A description will be given with reference to FIG. 10. FIG. 10 is a schematic diagram of the configuration of a computer device according to an embodiment of the present invention. As shown in FIG. 10, the computer device according to the embodiment of the present invention may include one or more processors 1001, a memory 1002, and an input / output interface 1003. The processor 1001, the memory 1002, and the input / output interface 1003 are connected via a bus 1004. The memory 1002 stores computer-readable instructions including program instructions. The input / output interface 1003 receives or outputs data and realizes data interaction between the computer device and the user device. The processor 1001 executes the program instructions stored in the memory 1002.

[0108] When the processor 1001 is within the computer device, it performs the following operations.

[0109] Obtain k component tracks and an atlas style corresponding to each component track. The component track includes a component track data box, the component track data box includes the number of tiles and spatial region information, the number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, the spatial region information is the spatial region of the component track to which the component track data box belongs, and k is a positive integer.

[0110] According to the component track data box, encapsulate the k component tracks and the atlas style corresponding to each component track to obtain a target file.

[0111] Alternatively, when the processor 1001 is within the computer device, it performs the following operations.

[0112] Obtain k component tracks in the target file. A component track includes a component track data box, and the component track data box includes the number of tiles and spatial region information. The number of tiles is the number of atlas tiles corresponding to the component track to which the component track data box belongs, and the spatial region information is the spatial region of the component track to which the component track data box belongs. Here, k is a positive integer.

[0113] Decapsulate the target file according to the component track data box to obtain tile display content.

[0114] In some possible embodiments, the processor 1001 may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), existing field-programmable gate arrays (FPGAs) or other programmable logic devices, individual gate or transistor logic devices, individual hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0115] The memory 1002 may include a read-only memory and a random access memory, and provides instructions and data to the processor 1001 and the input / output interface 1003. A part of the memory 1002 may further include a non-volatile random access memory. For example, the memory 1002 may further store information about the device type.

[0116] In a specific embodiment, the above-described computer device can execute the embodiments related to each step in FIG. 4 or FIG. 6 above by incorporated individual functional modules. The specific embodiment can refer to the embodiments related to each step in FIG. 4 or FIG. 6 above, which will not be described here.

[0117] Embodiments of the present invention provide a computer device including one or more processors, a memory, and an input / output interface. The processor obtains computer instructions in the memory and executes each step of the method shown in FIG. 4 or FIG. 6 above to perform data processing operations. Embodiments of the present invention can encapsulate one component track data box for each component track, and the component track data box indicates the related information of the component track where it is located. The related relationships such as atlas style information and component tracks (i.e., component tiles and component tracks) can be refined to the granularity of a single component track, and the information of the component track can be retained as comprehensively as possible. The information of the component track in the obtained target file after encapsulation can be made more orderly and refined. Further, after transmitting the target file to the user device, the user device can accurately select the required component track and achieve the purpose of partial decapsulation and partial decoding. Therefore, it is not necessary to perform overall decapsulation and decoding on the target file, saving the time and resources for data processing and improving the accuracy and efficiency of data processing.

[0118] Embodiments of the present invention include one or more computer-readable storage media storing computer-readable instructions, the computer-readable instructions being loaded and executed by a processor to cause a computer device having one or more processors to execute a data processing method including each step in FIG. 4 or FIG. 6. Details may be referred to the embodiments according to each step in FIG. 4 or FIG. 6, and the description thereof is omitted here. Also, the beneficial effects adopting the same method are not described. For technical details not disclosed in the embodiments of the computer-readable storage media according to the present invention, refer to the description of the embodiments of the method of the present invention. As an example, the program instructions may be arranged to be executed on one computer device, or on a plurality of computer devices arranged in one location, or on a plurality of computer devices arranged in a plurality of locations interconnected by a communication network.

[0119] Embodiments of the present invention further provide a computer program product including computer-readable instructions, the computer-readable instructions realizing the steps of the method of the embodiments of the present invention when executed by one or more processors.

[0120] The above-described computer-readable storage medium may be a data processing apparatus according to any of the above-described embodiments, or may be an internal storage device of a computer device such as a hard disk or memory of the computer device. The computer-readable storage medium may be an external storage device of a computer device such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, or a flash memory card equipped in the computer device. Further, the computer-readable storage medium may include both an internal storage unit and an external storage device of the computer device. The above computer-readable storage medium stores computer-readable instructions and other programs and data required by the computer device. The computer-readable storage medium may be used to temporarily store the output data or the data to be output.

[0121] The terms "comprising" in the specification, claims, and drawings of the embodiments of the present application, and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or device comprising a series of steps or units is not limited to the listed steps or modules, may include steps or modules not listed, or may include other step units specific to these processes, methods, apparatuses, products, or devices.

[0122] One of ordinary skill in the art will understand that the various example elements and algorithm steps described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both, and in order to clearly show the compatibility of hardware and software, in the above description, the configurations and steps of the various examples have been generally described functionally. Whether these functions are executed by hardware or software will vary depending on the particular application and design constraints. One of ordinary skill in the art can use different methods for each particular application to implement the described functions, but such implementations should not be considered to exceed the scope of the present invention.

[0123] The method and related apparatus according to embodiments of the present invention will be described with reference to the flowchart and / or schematic diagram of the structure of the method according to embodiments of the present invention. In particular, by computer-readable instructions, each flow and / or block of the flowchart and / or schematic diagram of the structure, and combinations of flows and / or blocks of the flowchart and / or block diagram may be implemented. These computer-readable instructions are provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device, so that instructions executed by the processor of the computer or other programmable data processing device generate means for realizing the functions specified in one or more flows of the flowchart and / or one or more blocks of the schematic diagram. These computer-readable instructions can also be stored in a computer-readable memory that can operate a computer or other programmable data processing device in a specific manner. As a result, the instructions stored in the computer-readable memory generate a manufactured product including instruction means for realizing the functions specified in one or more flows of the flowchart and / or one or more blocks of the schematic diagram. These computer-readable instructions may be loaded onto a computer or other programmable data processing device. As a result, a series of operation steps are executed on the computer or other programmable device to generate a process implemented by the computer. As a result, the instructions executed on the computer or other programmable device provide steps for realizing the functions specified in one or more flows of the flowchart and / or one or more blocks of the schematic diagram.

[0124] The above disclosure is only a preferred embodiment of the present invention and cannot limit the scope of the present invention thereby. Therefore, equivalent changes made according to the claims of the present invention are within the scope of the present invention.

Claims

1. A data processing method executed by a computer device, comprising: obtaining k component tracks and an atlas style corresponding to each component track, wherein the component track includes a component track data box, the component track data box includes the number of tiles and spatial region information, the number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, the spatial region information is the spatial region of the component track to which the component track data box belongs, and k is a positive integer; encapsulating the k component tracks and the atlas style corresponding to each component track according to the component track data box to obtain a target file; The component track data box includes a track group data box, The track group data box includes an atlas ID and an atlas style ID, The atlas ID indicates the ID of the atlas to which the atlas style belongs, The atlas style corresponding to each component track includes a first atlas style and a second atlas style, When the atlas ID associated with the first atlas style ID of the first atlas style is the same as the atlas ID associated with the second atlas style ID of the second atlas style, the first atlas style and the second atlas style belong to the same first tile track group, The atlas styles corresponding to the component tracks in the same tile track group belong to the same atlas, The component track further includes a component track type, The k component tracks include a first component track and a second component track, When the first component track type of the first component track is the same as the second component track type of the second component track, the atlas style corresponding to the first component track and the atlas style corresponding to the second component track belong to the same second tile track group, and the second tile track group is different from the first tile track group.

2. The component track data box includes a component information data box. The component information data box includes a data box type. The data box type indicates information of the component track to which the component information data box belongs as indicated by the component information data box. The k component tracks include a target component track. When encapsulating the component information data box into the target component track, the component information data box includes the atlas style and spatial region information corresponding to the target component track. The method according to claim 1.

3. The step of encapsulating the k component tracks and the atlas style corresponding to each component track according to the component track data box to obtain a target file is: Obtaining track group classification information, and based on the track group classification information, obtaining component track information of the k component tracks from the component track data boxes included in each of the k component tracks, where the track group classification information indicates a method of grouping the k component tracks. Step of classifying the k component tracks based on the track group classification information and the component track information to obtain M tile track groups, where M is a positive integer, and the step; The method according to claim 1 or 2, comprising: encapsulating the M tile track groups and the atlas styles associated with each tile track group to obtain a target file.

4. The track group classification information includes atlas classification information, The component track information of the k component tracks includes an atlas ID associated with an atlas style corresponding to each of the k component tracks, The atlas ID indicates the ID of the atlas to which the atlas style belongs, The step of classifying the k component tracks based on the track group classification information and the component track information to obtain M tile track groups is: In the k component tracks, grouping the component tracks corresponding to the atlas styles associated with the same atlas ID based on the atlas classification information to obtain M tile track groups, the method according to claim 3.

5. The track group classification information includes atlas component classification information, The component track information of the k component tracks includes an atlas ID associated with an atlas style corresponding to each of the k component tracks, and a component track type corresponding to each of the k component tracks, The atlas ID indicates the ID of the atlas to which the atlas style belongs, The step of classifying the k component tracks based on the track group classification information and the component track information to obtain M tile track groups is: In the k component tracks, based on the atlas component classification information, group the component tracks having the same component track type and related to the same atlas ID, and obtain M tile track groups, the method according to claim 3, comprising.

6. The step of classifying the k component tracks based on the track group classification information and the component track information to obtain M tile track groups is Based on the component track information, determining the component track type corresponding to each of the k component tracks and the atlas ID to which the atlas style corresponding to each of the k component tracks belongs, wherein the atlas ID indicates the ID of the atlas to which the atlas style belongs, the step of When there is a component track to be classified among the k component tracks, based on the atlas ID to which the atlas style corresponding to the component track to be classified belongs, dividing the component track to be classified into at least two component sub-tracks, wherein the component track to be classified corresponds to at least two atlas styles and the atlas IDs corresponding to each of the at least two atlas styles are different, and the component tiles corresponding to the same component sub-track are related to the same atlas ID, the step of Determining the at least two component sub-tracks and the normal component tracks as candidate component tracks, wherein the normal component track is a component track other than the component track to be classified among the k component tracks, the step of The method according to claim 3, comprising: classifying candidate component tracks having the same component track type and related to the same atlas ID, and obtaining M tile track groups.

7. The step of encapsulating the M tile track groups and the atlas styles related to each tile track group to obtain a target file includes: obtaining a track index i of component track type information corresponding to the i-th tile track group among the M tile track groups, where i is a positive integer not exceeding M; adding the track index i for the i-th tile track group, and associating the i-th tile track group with the atlas style corresponding to the component tracks included in the i-th tile track group based on the track index i; The method according to claim 3, comprising: encapsulating the M tile track groups and the atlas styles related to each tile track group based on the association result to obtain a target file.

8. A data processing method executed by a computer device, comprising: obtaining k component tracks in a target file, where the component track includes a component track data box, the component track data box includes the number of tiles and spatial region information, the number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, the spatial region information is the spatial region of the component track to which the component track data box belongs, and k is a positive integer; and decrypting the target file according to the component track data box to obtain tile display content. The component track data box includes a track group data box, The track group data box includes an atlas ID and an atlas style ID, The atlas ID indicates the ID of the atlas to which the atlas style belongs, The atlas styles corresponding to the respective component tracks include a first atlas style and a second atlas style, When the atlas ID associated with the first atlas style ID of the first atlas style is the same as the atlas ID associated with the second atlas style ID of the second atlas style, the first atlas style and the second atlas style belong to the same first tile track group, The atlas styles corresponding to the component tracks in the same tile track group belong to the same atlas, The component track further includes a component track type, The k component tracks include a first component track and a second component track, When the first component track type of the first component track is the same as the second component track type of the second component track, the atlas style corresponding to the first component track and the atlas style corresponding to the second component track belong to the same second tile track group, and the second tile track group is different from the first tile track group.

9. The step of decapsulating a target file according to the component track data box and obtaining tile display content is When responding to a display request for a target component track, obtaining a target component track data box included in the target component track from the target file, and obtaining the number of target tiles corresponding to the target component track from the target component track data box; Performing h iterative decapsulations on the target file based on the number of target tiles, and obtaining tile display content corresponding to the target component track, where h is the number of target tiles, the step of, the method according to claim 8.

10. The step of decapsulating the target file according to the component track data box and obtaining tile display content is When responding to a display request for an atlas tile to be processed, obtaining the atlas tile ID of the atlas tile to be processed; Obtaining a component track data box included in each of the k component tracks from the target file, and performing a scanning search on the component track data box included in each of the k component tracks based on the number of tiles in the component track data box and the atlas tile ID to be processed; Determining the component track to which the component track data box in which the atlas tile ID to be processed is found belongs as the component track to be processed; Performing a decapsulation process on the component track to be processed, and obtaining tile display content corresponding to the atlas tile to be processed, the method according to claim 8.

11. The step of decapsulating the target file according to the component track data box and obtaining tile display content is Decapsulating a target file according to the component track data box, and obtaining the k component tracks and the atlas style corresponding to each component track; Determining a spatial region where the k component tracks in the volumetric video are located based on spatial region information in the component track data box included in each of the k component tracks; Generating tile display content based on the spatial region where the k component tracks in the volumetric video are located and the atlas style corresponding to each component track, the method according to claim 8.

12. A data processing device, A data acquisition module for acquiring k component tracks and the atlas style corresponding to each component track, wherein the component track includes a component track data box, the component track data box includes the number of tiles and spatial region information, the number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, the spatial region information is the spatial region of the component track to which the component track data box belongs, and k is a positive integer, the data acquisition module; A data encapsulation module for encapsulating the k component tracks and the atlas style corresponding to each component track according to the component track data box to obtain a target file; The component track data box includes a track group data box, The track group data box includes an atlas ID and an atlas style ID, The atlas ID indicates the ID of the atlas to which the atlas style belongs, The atlas styles corresponding to the respective component tracks include a first atlas style and a second atlas style. When the atlas ID associated with the first atlas style ID of the first atlas style is the same as the atlas ID associated with the second atlas style ID of the second atlas style, the first atlas style and the second atlas style belong to the same first tile track group. The atlas styles corresponding to the component tracks in the same tile track group belong to the same atlas. The component track further includes a component track type. The k component tracks include a first component track and a second component track. When the first component track type of the first component track is the same as the second component track type of the second component track, the atlas style corresponding to the first component track and the atlas style corresponding to the second component track belong to the same second tile track group, and the second tile track group is different from the first tile track group.

13. A data processing device, A track acquisition module for acquiring k component tracks in a target file, where the component track includes a component track data box, the component track data box includes the number of tiles and spatial region information, the number of tiles is the number of atlas styles corresponding to the component track to which the component track data box belongs, the spatial region information is the spatial region of the component track to which the component track data box belongs, and k is a positive integer. A data decapsulation module that decapsulates a target file according to the component track data box and obtains tile display content. The component track data box includes a track group data box. The track group data box includes an atlas ID and an atlas style ID. The atlas ID indicates the ID of the atlas to which the atlas style belongs. The atlas styles corresponding to each component track include a first atlas style and a second atlas style. When the atlas ID associated with the first atlas style ID of the first atlas style is the same as the atlas ID associated with the second atlas style ID of the second atlas style, the first atlas style and the second atlas style belong to the same first tile track group. The atlas styles corresponding to the component tracks in the same tile track group belong to the same atlas. The component track further includes a component track type. The k component tracks include a first component track and a second component track. When the first component track type of the first component track is the same as the second component track type of the second component track, the atlas style corresponding to the first component track and the atlas style corresponding to the second component track belong to the same second tile track group, and the second tile track group is different from the first tile track group. Device.

14. A computer device including one or more processors, a memory, and an input / output interface. The processor is connected to the memory and the input / output interface respectively. The input / output interface transmits and receives data. The memory stores computer-readable instructions. The processor calls the computer-readable instructions so as to cause the computer device to execute the method according to any one of claims 1 or 2, or claims 8 to 11. A computer device.

15. One or more computer-readable storage media storing computer-readable instructions, wherein the computer-readable instructions are loaded and executed by the processor so as to cause a computer device having one or more processors to execute the method according to any one of claims 1 or 2, or claims 8 to 11. A storage medium.

16. A computer program including computer-readable instructions, wherein the computer-readable instructions, when executed by one or more processors, implement the steps of the method according to any one of claims 1 or 2, or claims 8 to 11. A computer program.

Images