Distribution device, distribution method, and program

JP7635860B2Active Publication Date: 2025-02-26NIPPON TELEGRAPH & TELEPHONE CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023559395
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-11-15
Publication Date
2025-02-26
Estimated Expiration
2041-11-15

AI Technical Summary

Benefits of technology

【0012】 立体映像コンテンツに対するチャンク配信方式を実現することができる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007635860000001
    Figure 0007635860000001
  • Figure 0007635860000002
    Figure 0007635860000002
  • Figure 0007635860000003
    Figure 0007635860000003
Patent Text Reader

Abstract

A distribution device according to one embodiment distributes, to a terminal, stereoscopic video content consisting of a polygon mesh and texture. The distribution device includes: a first chunk creation unit that creates a plurality of first chunk data pieces from mesh frame data pieces each representing a frame data piece of the polygon mesh; a second chunk creation unit that creates a plurality of second chunk data pieces from texture frame data pieces each representing a frame data piece of the texture; and a chunk distribution unit that, in response to a chunk distribution request from the terminal, transmits to the terminal the first chunk data and / or the second chunk data pertaining to the chunk distribution request.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a technology for distributing stereoscopic video content such as volumetric video and holograms. [Background technology]

[0002] Three-dimensional video content with six degrees of freedom (6DoF), such as volumetric video and holograms, is well known. In order to distribute such content with high quality over a communication network, a mechanism for controlling the distribution of the content itself is required in addition to the use of high-performance data compression technology and communication network / system load balancing technology. In particular, a mechanism for dynamically controlling the distribution of content according to the visibility information of the client XR (VR / AR / MR / SR, etc.) device and the user's position information in the virtual space is important.

[0003] Volumetric video is animation data of objects composed of polygon meshes (hereinafter simply referred to as "meshes") and textures, and is displayed and viewable on the display of an XR device by rendering it together with the virtual environment on the client side.

[0004] As volumetric video distribution technologies, the technologies described in Non-Patent Documents 1 to 3 are known. Non-Patent Document 1 proposes a method in which volumetric video is rendered on the server side based on the movement of the user's head detected by an AR / VR device, which is a client, and transmitted to the client as 2D data. Non-Patent Document 2 proposes a method in which volumetric video generated in real time is distributed to a client and rendered on the client side. Furthermore, Non-Patent Document 3 proposes a mechanism called MPEG-DASH for the distribution of 2D video content data. In MPEG-DASH, data of 2D video content is divided into files called chunks (or segments), and a terminal that plays back 2D video transmits a request to acquire chunk files to a data distribution server based on a manifest file in which a list of chunk files and the like are described. Such a data distribution method is also called a chunk distribution method. [Prior art documents] [Non-patent literature]

[0005] [Non-Patent Document 1] Serhan Gul, Dimitri Podborski, Thomas Buchholz, Thomas Schierl and Cornelius Hellge, "Low-latency cloud-based volumetric video streaming using head motion prediction," https: / / arxiv.org / abs / 2001.06466 [Non-Patent Document 2] Sergio Orts-Escolano et al., "Holoportation: Virtual 3D teleportation in real-time," https: / / dl.acm.org / doi / 10.1145 / 2984511.2984517 [Non-Patent Document 3] MPEG-DASH, https: / / mpeg.chiariglione.org / standards / mpeg-dash Summary of the Invention [Problem to be solved by the invention]

[0006] However, volumetric video requires a large amount of data and therefore requires a large bandwidth of the communication network to distribute it, so there is a demand for an efficient distribution method.

[0007] However, in the method proposed in the above-mentioned non-patent document 1, rendering for each user needs to be performed on the server side, which places a heavy load on the server. In addition, when the number of users increases, the quality of the video viewed by each user may deteriorate due to the division of server resources. Furthermore, position information needs to be transmitted from the client to the server frequently and with low latency. For example, suppressing the Motion to Photon latency, at which VR sickness begins to occur, to 20 ms or less places a heavy burden on both the communication network and the server.

[0008] On the other hand, the method proposed in the above non-patent document 2 requires a communication bandwidth of 4 Gbps, but it is difficult for users to always stably secure a communication bandwidth of 4 Gbps. In addition, since the load on the communication network is large, the available bandwidth of other users using the same communication network is narrowed, and the quality of experience of other users is degraded. Furthermore, since 2D data is delivered frame by frame, the load of loading each frame into memory is high. For example, when playing a video on a low-performance PC or when the network bandwidth is insufficient, the 2D data is not buffered and the video is frequently interrupted.

[0009] On the other hand, it is thought that the above problems can be solved by using a chunk delivery method, but the chunk delivery method described in Non-Patent Document 3 is targeted at 2D video content and requires the data format to be, for example, MP4 format.

[0010] An embodiment of the present invention has been made in consideration of the above points, and has an object to realize a chunk delivery method for stereoscopic video content. [Means for solving the problem]

[0011] In order to achieve the above-mentioned object, a distribution device of one embodiment is a distribution device that distributes stereoscopic video content of an object composed of a polygon mesh and a texture to a terminal, and has a first chunk creation unit that creates multiple first chunk data from each mesh frame data representing each frame data of the polygon mesh, a second chunk creation unit that creates multiple second chunk data from each texture frame data representing each frame data of the texture, and a chunk distribution unit that, in response to a chunk distribution request from the terminal, transmits at least one of the first chunk data and the second chunk data related to the chunk distribution request to the terminal. Effect of the Invention

[0012] A chunk delivery method for stereoscopic video content can be realized. [Brief description of the drawings]

[0013] [Figure 1] 1 is a diagram illustrating an example of an overall configuration of a distribution system according to an embodiment of the present invention. [Diagram 2] 11 is a flowchart illustrating an example of a chunk data creation process according to the embodiment. [Diagram 3] FIG. 10 is a diagram illustrating an example of chunking of a polygon mesh frame. [Figure 4] FIG. 10 is a diagram illustrating an example of chunking of texture frames. [Diagram 5] FIG. 11 is a sequence diagram showing an example of a volumetric video playback process according to the embodiment. [Figure 6] FIG. 10 is a diagram illustrating an example of rendering of chunk data. [Figure 7] FIG. 2 is a diagram illustrating an example of a hardware configuration of a distribution server according to the present embodiment. [Figure 8] FIG. 2 is a diagram illustrating an example of a hardware configuration of a client terminal according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] An embodiment of the present invention will be described below. In this embodiment, a delivery system 1 that realizes a chunk delivery method for volumetric video will be described, with a volumetric video being taken as an example of stereoscopic video content. Here, volumetric video refers to animation data made up of 3D data (also called three-dimensional data or stereoscopic data) of an object (including people, animals, etc.) represented by a mesh and a texture. That is, for example, 3D data in a frame at time t is delivered as d t Then, volumetric video is {d t =(m t ,n t )|t∈[t s ,t e ]}. m t is the mesh data of the frame at time t, n t is the texture data of the frame at time t, and s is the start time of the volumetric video, t e is the end time. t Let m be the 3D frame data at time t. t is the mesh frame data at time t, n t is also called the texture frame data at time t. For simplicity, t s = 1, t e =T.

[0015] It should be noted that the embodiment described below is not limited to volumetric video, but can also be similarly applied to stereoscopic video content having six degrees of freedom, such as a hologram.

[0016] <Overall configuration of distribution system 1> First, the overall configuration of a distribution system 1 according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the overall configuration of the distribution system 1 according to this embodiment.

[0017] 1, a distribution system 1 according to the present embodiment includes a distribution server 10, a client terminal 20, and a viewing device 30. The distribution server 10 and the client terminal 20 are communicatively connected via a communication network N such as the Internet. Meanwhile, the client terminal 20 and the viewing device 30 are communicatively connected by any wired or wireless connection method.

[0018] The distribution server 10 creates chunk data by dividing each of the mesh frame data and texture frame data contained in each 3D frame data that constitutes the volumetric video into groups called chunks, and also creates chunk information that includes the number of each chunk (hereinafter also referred to as the chunk number) and the data size of each chunk (hereinafter also referred to as the chunk size).

[0019] Furthermore, the distribution server 10 transmits chunk information in response to a viewing start request from the client terminal 20, and transmits the corresponding chunk data in response to a chunk distribution request from the client terminal 20.

[0020] The client terminal 20 is a variety of terminals (e.g., PCs, game devices, etc.) used by users who want to watch volumetric videos. The client terminal 20 determines chunk data to be requested to be delivered from the delivery server 10 based on the chunk information. The client terminal 20 also buffers the chunk data delivered from the delivery server 10, renders the chunk data, and transmits the video data as a stream to the viewing device 30.

[0021] The viewing device 30 is a terminal for viewing a volumetric video, and plays the volumetric video based on the video data received from the client terminal 20. Examples of the viewing device 30 include a head mounted display (HMD) that functions as an XR (VR / AR / MR / SR, etc.) device, a smartphone or tablet terminal equipped with an application program that functions as an XR device, a wearable device, and the like.

[0022] For example, when the client terminal 20 also functions as an XR device, volumetric video may be played on the client terminal 20. In this case, the viewing device 30 is not required.

[0023] Here, the distribution server 10 according to this embodiment includes a chunk creation unit 101, a request receiving unit 102, a data distribution unit 103, and a data storage unit 104.

[0024] The chunk creation unit 101 creates chunk data from the volumetric video stored in the data storage unit 104. At this time, the chunk creation unit 101 divides mesh frame data included in the 3D frame data constituting the volumetric video into chunks, and compresses each chunk to create mesh chunk data. Similarly, the chunk creation unit 101 divides texture frame data included in the 3D frame data constituting the volumetric video into chunks, and compresses each chunk to create texture chunk data. Then, the chunk creation unit 101 assigns chunk numbers to each mesh chunk data and each texture chunk data, and stores them in the data storage unit 104. Hereinafter, the chunk numbers assigned to the mesh chunk data are also referred to as mesh chunk numbers, and the chunk numbers assigned to the texture chunk data are also referred to as texture chunk numbers. Note that the chunk numbers are assigned in chronological order, starting from 1.

[0025] Furthermore, the chunk creation unit 101 creates chunk information including a mesh chunk number and a chunk size of the mesh chunk data corresponding to the chunk number, and a texture chunk number and a chunk size of the texture chunk data corresponding to the chunk number. Then, the chunk creation unit 101 stores the chunk information in the data storage unit 104 in association with the volumetric video.

[0026] The request receiving unit 102 receives a viewing start request or a chunk delivery request from the client terminal 20. The viewing start request is a request to start viewing a volumetric video, and includes, for example, the ID of the volumetric video that the user wishes to view. Moreover, the chunk delivery request is a delivery request for chunk data, and includes, for example, the chunk number of the chunk data (at least one of the mesh chunk number and the texture chunk number).

[0027] When the request receiving unit 102 receives a viewing start request, the data delivering unit 103 transmits chunk information associated with the volumetric video of the ID included in the viewing start request to the requesting client terminal 20. When the request receiving unit 102 receives a chunk delivery request, the data delivering unit 103 transmits chunk data of the chunk number included in the chunk delivery request to the requesting client terminal 20.

[0028] The data storage unit 104 stores the volumetric video, chunk data (mesh chunk data and texture chunk data) created from the volumetric video, and chunk information. Note that the volumetric video is assigned an ID (hereinafter, also referred to as a volumetric video ID) that uniquely identifies the volumetric video.

[0029] Moreover, the client terminal 20 according to this embodiment includes a data receiving unit 201 , a requested chunk determining unit 202 , a request transmitting unit 203 , a rendering unit 204 , and a buffer unit 205 .

[0030] The data receiving unit 201 receives chunk information and chunk data from the distribution server 10. Furthermore, the data receiving unit 201 buffers (temporarily stores) the chunk data received from the distribution server 10 in a buffer unit 205.

[0031] The requested chunk determination unit 202 determines the chunk number of the chunk data for which delivery is requested to the delivery server 10, based on the chunk information.

[0032] When starting viewing of a volumetric video, the request sending unit 203 sends a viewing start request to the distribution server 10. Also, when a chunk number is determined by the requested chunk determining unit 202, the request sending unit 203 sends a chunk delivery request including the chunk number to the distribution server 10.

[0033] The rendering unit 204 generates video data by rendering the chunk data (mesh chunk data and texture chunk data) buffered in the buffer unit 205 together with the virtual environment. The rendering unit 204 then transmits the video data to the audiovisual device 30 as a stream.

[0034] The buffer unit 205 buffers (temporarily stores) the mesh chunk data and texture chunk data received from the distribution server 10.

[0035] <Chunk data creation process> Hereinafter, the chunk data creation process according to this embodiment will be described with reference to Fig. 2. Fig. 2 is a flowchart showing an example of the chunk data creation process according to this embodiment. Note that this chunk data creation process is performed offline (i.e., performed in advance before playing back the volumetric video).

[0036] The chunk creation unit 101 of the distribution server 10 creates 3D frame data {d t =(m t ,nt ) the mesh frame data {m included in |t∈[1,T]} t |t∈[1,T]} and the texture frame data {n t |t∈[1,T]} are each divided into chunks (step S101).

[0037] At this time, regarding the mesh frame data {m t |t∈[1,T]}, for example, the chunk creation unit 101 analyzes the content of each 3D frame data d t (or each polygon mesh frame m t ), and based on frame interpolation, etc., divides the mesh frame data {m t |t∈[1,T]} into chunks so that the chunk size of each chunk is the smallest.

[0038] On the other hand, regarding the texture frame data {n t |t∈[1,T]}, for example, the chunk creation unit 101 analyzes the adjacent texture frame data n t and n t+1 in order from t = 1, and takes the texture frame data before the texture structure changes significantly as one chunk, and divides the texture frame data {n t |t∈[1,T]} into chunks. For example, when the texture structure changes significantly at times t1, t2, t3 (where t1 < t2 < t3), {n t |t∈[1,t1 - 1]} and {n t |t∈[t1,t2 - 1]} and {n t |t∈[t2,t3 - 1]} and {n t |t∈[t3,T]} are divided into four chunks. Here, the case where the texture structure changes significantly means, for example, the texture represented by the texture frame data n t and the texture frame data n t+1When comparing the brightness, color, shading, pattern, etc., quantified between the texture represented by the texture frame data n and the texture represented by the texture frame data n, at least some of these have changed by a predetermined threshold value or more. t The texture and texture frame data represented by n t+1 It may also be the case that, when brightness, color, shade, pattern, etc. are quantified and a weighted sum is calculated between the texture represented by the texture shown by the texture image and the texture represented by the texture image, the value of the weighted sum has changed by more than a predetermined threshold value.

[0039] It should be noted that in step S101 above, the mesh frame data and the texture frame data are divided into chunks independently of each other.

[0040] Next, the chunk creation unit 101 of the distribution server 10 compresses each frame data (each mesh frame data and each texture frame data) so that the chunk size of each chunk divided in the above step S101 becomes the smallest (step S102). That is, with respect to the mesh frame data, the chunk creation unit 101 compresses each mesh frame data m t Similarly, for the texture frame data, the chunk creation unit 101 compresses each of the texture frame data n so that the chunk size of each chunk divided in the above step S101 is minimized. t As a result, mesh chunk data made up of mesh frame data compressed on a chunk-by-chunk basis, and texture chunk data made up of texture frame data compressed on a chunk-by-chunk basis are created.

[0041] Next, the chunk creation unit 101 of the distribution server 10 stores the mesh chunk data and texture chunk data created in the above step S101 in the data storage unit 104 (step S103). At this time, the chunk creation unit 101 also assigns a mesh chunk number to each piece of mesh chunk data, and also assigns a texture chunk number to each piece of texture chunk data.

[0042] An example of mesh chunk data is shown in Fig. 3. In the example shown in Fig. 3, mesh frame data m1 to m 10 is divided into one chunk, and these mesh frame data m1 to m 10 The mesh chunk data consisting of the compressed data of each of the above is the mesh chunk data with mesh chunk number "1". Similarly, the mesh frame data m 11 ~m 15 are divided into one chunk, and these mesh frame data m 11 ~m 15 The mesh chunk data composed of the compressed data of each of the above is the mesh chunk data with mesh chunk number “2”.

[0043] An example of texture chunk data is shown in Fig. 4. In the example shown in Fig. 4, texture frame data n1 to n 10 is divided into one chunk, and these texture frame data n1~n 10 The texture frame data consisting of the compressed data of each of the above is the texture frame data of texture chunk number "1". Similarly, the texture frame data n 11 ~n 30 is divided into one chunk, and these texture frame data n 11 ~n 30 The texture frame data for texture chunk number "2" is made up of compressed data for each of the above.

[0044] Then, the chunk creation unit 101 of the distribution server 10 creates chunk information including a chunk number and a chunk size, associates it with the volumetric video, and stores it in the data storage unit 104 (step S104). Specifically, the chunk information includes a mesh chunk number and the chunk size of the mesh chunk data of that chunk number, and a texture chunk number and the chunk size of the texture chunk data of that chunk number.

[0045] <Volumetric video playback processing> Hereinafter, the volumetric video playback process according to this embodiment will be described with reference to Fig. 5. Fig. 5 is a sequence diagram showing an example of the volumetric video playback process according to this embodiment.

[0046] The request sending unit 203 of the client terminal 20 sends a viewing start request to the distribution server 10 (step S201). Here, the viewing start request includes the volumetric video ID of the volumetric video that the user wishes to view.

[0047] When the request receiving unit 102 receives a viewing start request, the data distribution unit 103 of the distribution server 10 obtains chunk information corresponding to the volumetric video of the volumetric video ID included in the viewing start request from the data storage unit 104, and transmits the obtained chunk information to the client terminal 20 that originated the request (step S202).

[0048] The following steps S203 to S208 are repeatedly executed while the user is watching the volumetric video.

[0049] The requested chunk determination unit 202 of the client terminal 20 determines chunk numbers (mesh chunk numbers and texture chunk numbers) of chunk data requested to be delivered from the delivery server 10 based on the chunk information (step S203). Here, the requested chunk determination unit 202 may determine chunk numbers of chunk data requested to be delivered by a method similar to a known chunk delivery method. For example, it is assumed that mesh chunk data up to mesh chunk number "k1" and texture chunk data up to texture chunk number "k2" have been received. In this case, the requested chunk determination unit 202 determines mesh chunk numbers after "k1+1" and texture chunk numbers after "k2+1" as chunk numbers of chunk data requested to be delivered from the delivery server 10 based on conditions such as the current network bandwidth and free space of the buffer unit 205, chunk sizes of mesh chunk data after mesh chunk number "k1+1", and chunk sizes of texture chunk data after texture chunk number "k2+1". Note that, for example, there may be cases where only either the mesh chunk number or the texture chunk number is determined as the chunk number of chunk data requested to be distributed to the distribution server 10.

[0050] Next, the request sending unit 203 of the client terminal 20 sends a chunk delivery request including the chunk numbers (mesh chunk number and texture chunk number) determined in the above step S203 to the delivery server 10 (step S204). Note that there may be cases where only one of the mesh chunk number and the texture chunk number is included in the chunk delivery request.

[0051] When the data distribution unit 103 of the distribution server 10 receives a chunk distribution request from the request reception unit 102, it transmits the chunk data (mesh chunk data and texture chunk data) of the chunk number included in the chunk distribution request among the chunk data of the volumetric video with the volumetric video ID included in the viewing start request received in step S202 above to the requesting client terminal 20 (step S205).

[0052] When the data reception unit 201 of the client terminal 20 receives chunk data (mesh chunk data and texture chunk data) from the distribution server 10, it stores these chunk data in the buffer unit 205 (step S206). As a result, the mesh chunk data and the texture chunk data are buffered in the buffer unit 205.

[0053] The following steps S207 to S208 are repeatedly executed in parallel with the above steps S203 to S206 until the capacity of the buffer unit 205 falls below another certain threshold th2 (<th1) when the capacity of the buffer unit 205 exceeds a certain threshold th1. For example, typically, when the buffer unit 205 is full, the following steps S207 to S208 are repeatedly executed in parallel with the above steps S203 to S206 until the buffer unit 205 becomes empty.

[0054] The rendering unit 204 of the client terminal 20 renders the chunk data (mesh chunk data and texture chunk data) buffered in the buffer unit 205 together with the virtual environment (step S207). This generates video data. An example of the rendering of the chunk data (mesh chunk data and texture chunk data) buffered in the buffer unit 205 is shown in FIG. 6. In the example shown in FIG. 6, mesh chunk data 1 with mesh chunk number "1" to mesh chunk data 4 with mesh chunk number "4" and texture chunk data 1 with texture chunk number "1" to texture chunk data 2 with texture chunk number "2" are buffered in the buffer unit 205, and frame data (mesh frame data and texture frame data) included in these chunk data are rendered in chronological order.

[0055] It should be noted that the chunk data for which all frame data has been rendered is deleted from the buffer unit 205. This makes it possible to buffer new chunk data in the buffer unit 205 in step S206 above.

[0056] The rendering unit 204 of the client terminal 20 transmits the video data generated in step S207 above as a stream to the viewing device 30 (step S208). As a result, the viewing device 30 plays back the volumetric video based on the video data received from the client terminal 20.

[0057] <Hardware configuration of distribution server 10 and client terminal 20> <Distribution Server 10> Next, a hardware configuration of the distribution server 10 according to the present embodiment will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of a hardware configuration of the distribution server 10 according to the present embodiment.

[0058] 7, the distribution server 10 according to the present embodiment includes an external I / F 301, a communication I / F 302, a processor 303, and a memory device 304. Each of these pieces of hardware is connected to each other via a bus 305 so as to be able to communicate with each other.

[0059] The external I / F 301 is an interface with an external device such as a recording medium 301a. Examples of the recording medium 301a include a CD (Compact Disc), a DVD (Digital Versatile Disk), an SD memory card (Secure Digital memory card), and a USB (Universal Serial Bus) memory card.

[0060] The communication I / F 302 is an interface for connecting the distribution server 10 to the communication network N. The processor 303 is, for example, various arithmetic devices such as a CPU (Central Processing Unit). The memory device 304 is, for example, various storage devices such as a HDD (Hard Disk Drive), an SSD (Solid State Drive), a RAM (Random Access Memory), a ROM (Read Only Memory), and a flash memory.

[0061] The distribution server 10 according to the present embodiment has the above hardware configuration and can realize the above-mentioned various processes. However, the hardware configuration shown in FIG. 7 is an example, and the distribution server 10 may have other hardware configurations. For example, the distribution server 10 may further have hardware such as an input device such as a keyboard or a mouse, and a display device such as a display. Also, for example, the distribution server 10 may have a plurality of processors 303 and a plurality of memory devices 304.

[0062] 1 are realized by, for example, one or more programs installed in the distribution server 10, which are executed by the processor 303. The data storage unit 104 shown in Fig. 1 is realized by, for example, an auxiliary storage device such as an HDD or SSD. However, the data storage unit 104 may also be realized by, for example, a database server connected to the distribution server 10 via a communication network.

[0063] <Client terminal 20> Next, a hardware configuration of the client terminal 20 according to this embodiment will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of a hardware configuration of the client terminal 20 according to this embodiment.

[0064] 8, the client terminal 20 according to this embodiment includes an input device 401, a display device 402, an external I / F 403, a communication I / F 404, a processor 405, and a memory device 406. Each of these pieces of hardware is connected to each other via a bus 407 so as to be able to communicate with each other.

[0065] The input device 401 is, for example, a keyboard, a mouse, a touch panel, etc. The display device 402 is, for example, a display, etc. Note that the client terminal 20 does not necessarily have to have at least one of the input device 401 and the display device 402, for example.

[0066] The external I / F 403 is an interface with an external device such as a recording medium 403a. Examples of the recording medium 403a include a CD, a DVD, an SD memory card, and a USB memory card.

[0067] The communication I / F 404 is an interface for connecting the client terminal 20 to the communication network N and transmitting video data to the audiovisual device 30. The processor 405 is, for example, various types of arithmetic devices such as a CPU or a GPU (Graphics Processing Unit). The memory device 406 is, for example, various types of storage devices such as an HDD, SSD, RAM, ROM, and flash memory.

[0068] The client terminal 20 according to this embodiment has the above hardware configuration and can realize the above-mentioned various processes. However, the hardware configuration shown in Fig. 8 is only an example, and the client terminal 20 may have other hardware configurations. For example, the client terminal 20 may have multiple processors 405 and multiple memory devices 406.

[0069] 1 are realized by, for example, one or more programs installed in the client terminal 20, which are executed by the processor 405. The buffer unit 205 shown in FIG. 1 is realized by, for example, the memory device 406.

[0070] <Summary> As described above, when implementing the chunk delivery method, the delivery system 1 according to the present embodiment chunks the mesh frame data and the texture frame data included in the 3D frame data constituting the volumetric video, respectively. This makes it possible to compress each chunk of mesh frame data and each chunk of texture frame data at a high compression rate, and it becomes possible to reduce the chunk size of the mesh chunk data and the chunk size of the texture chunk data. This makes it possible to reduce the processing load of the client terminal 20, and it becomes possible to realize playback with less interruption even for stereoscopic video content such as volumetric video, which has a larger data size than 2D video content.

[0071] The present invention is not limited to the above-described embodiments specifically disclosed, and various modifications, changes, combinations with known technologies, etc. are possible without departing from the scope of the claims. [Explanation of symbols]

[0072] 1. Distribution System 10 Distribution Server 20 Client Terminals 30 Viewing Devices 101 Chunk Creation Department 102 Request Reception Unit 103 Data Distribution Department 104 Data storage unit 201 Data receiving unit 202 Request chunk determination part 203 Request sending part 204 Rendering Department 205 Buffer section 301 External I / F 301a Recording medium 302 Communication I / F 303 Processor 304 Memory Device 305 Bus 401 Input Device 402 Display device 403 External I / F 403a Recording media 404 Communication I / F 405 Processor 406 Memory Device 407 Bus N Communication Network

Claims

1. A distribution device that distributes stereoscopic video content of an object configured with a polygon mesh and a texture to a terminal, comprising: a first chunk creation unit that creates a plurality of first chunk data from each mesh frame data that respectively represents each frame data of the polygon mesh; a second chunk creation unit that creates a plurality of second chunk data from each texture frame data that respectively represents each frame data of the texture; a chunk delivery unit that transmits at least one of a first chunk of data and a second chunk of data related to the chunk delivery request to the terminal in response to the chunk delivery request from the terminal; A distribution device having the above configuration.

2. The first chunk creation unit, The distribution device according to claim 1, further comprising: a processor for generating a plurality of first chunk data by analyzing the contents of each mesh frame data or each frame data of the stereoscopic video content, and dividing each mesh frame data into a plurality of chunks based on frame interpolation so that the size of each chunk is minimized.

3. The second chunk creation unit, 3. The distribution device according to claim 1 or 2, further comprising: analyzing adjacent texture frame data among the texture frame data in chronological order; and if the structure of the texture has changed by a predetermined amount or more between the texture frame data adjacent to the time, dividing the texture frame data into a plurality of chunks, with each texture frame data up to the time when the structure of the texture has changed by the predetermined amount or more as one chunk, thereby creating the plurality of second chunk data.

4. The distribution device according to claim 3 , wherein the structure of the texture is at least one of brightness, color, shade, and pattern of the texture.

5. a chunk information creating unit that creates chunk information including a chunk number and a data size of each of the plurality of first chunk data and a chunk number and a data size of each of the plurality of second chunk data; a chunk information delivery unit that transmits chunk information related to the viewing start request to the terminal in response to the viewing start request from the terminal, The delivery device according to claim 1 , wherein the chunk delivery request includes a chunk number determined in the terminal based on the chunk information.

6. A computer that distributes 3D video content of an object composed of a polygon mesh and a texture to a terminal, a first chunk creation step of creating a plurality of first chunk data from each mesh frame data representing each frame data of the polygon mesh; a second chunk creation step of creating a plurality of second chunk data from each texture frame data representing each frame data of the texture; a chunk delivery procedure of transmitting, in response to a chunk delivery request from the terminal, at least one of first chunk data and second chunk data related to the chunk delivery request to the terminal; The delivery method to be performed.

7. A program for causing a computer to function as the distribution device according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Systems and methods for real-time complex character animation and interaction

    JP2020529691A

  • Processing and / or transmitting 3D data

    US20150262421A1