Unlock instant, AI-driven research and patent intelligence for your innovation.

Streaming volumetric and non-volumetric video

A volume and video technology, applied in the field of composite video streams, which can solve problems such as large bandwidth

Pending Publication Date: 2021-08-10
KONINK KPN NV +1
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

A related problem may be the relatively large bandwidth required to transmit the two bitstreams

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Streaming volumetric and non-volumetric video
  • Streaming volumetric and non-volumetric video
  • Streaming volumetric and non-volumetric video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0212] The following embodiments relate to the generation and rendering of composite video streams. Some embodiments are described within the context of spatially segmented streaming, e.g., "tile-based streaming" [4], [5], which can be used to transmit panoramic or omnidirectional video, such as 360-degree video . However, the techniques described in this specification can also be applied to any other type of streaming, including non-spatial segmented (non-tiled) streaming.

[0213] Some embodiments are described in the context of rendering composite video streams in VR, such as a "social VR" virtual environment, where multiple users may participate in a conference call using a head-mounted display (HMD) and a camera. However, the techniques described in this specification can also be applied to all other applications where the volumetric video is to be displayed in front of the non-volumetric video and where the volumetric video stream is then overlaid ("occluded") Part of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A processor system and computer-implemented method are provided for generating a composite video stream which may include a non-volumetric video and a volumetric video, at least part of which is to be displayed in front of the non-volumetric video. The volumetric video may be included in the composite video stream in the form of a non-volumetric representation of the volumetric video, for example inserted into a spatial subregion of the non-volumetric video which may be occluded by the volumetric video during display. The encoding, transmission and decoding may thus not have to be modified to support volumetric video. Signaling data may be provided which may be indicative of the composite video stream containing the non-volumetric representation of the volumetric video. A processor system and computer-implemented method may be provided for rendering the composite video stream using the signaling data.

Description

technical field [0001] The present invention relates to a method and processor system for generating a composite video stream for display by a client device, for example in an augmented reality or virtual reality environment. The invention further relates to a computer readable medium comprising signaling data for generating a composite video stream. The invention further relates to a method and processor system representing a client device for rendering a composite video stream. The invention further relates to a computer program for carrying out the method. Background technique [0002] It may be desirable to transmit both volumetric and non-volume video to a client device for simultaneous display by the client device. [0003] Such scenarios may occur, for example, in the fields of virtual reality (VR) and augmented reality (AR). Here, VR involves the use of computer technology to simulate the user's physical presence in a virtual environment, while AR refers to the us...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/218H04N21/2343H04N21/262H04N21/4728H04N21/81H04N21/845H04N21/858
CPCH04N21/21805H04N21/23439H04N21/26258H04N21/4728H04N21/816H04N21/8456H04N21/8586H04N21/235H04N21/4312
Inventor O·A·尼亚穆特E·托马斯S·迪克斯特拉-索达里萨纳内
Owner KONINK KPN NV