System and method for providing 360 degrees immersive video based on gaze vector information

An immersive, video technology, applied in the field of communication network, to achieve the effect of reducing delay and high video QoE

Pending Publication Date: 2021-02-05
TELEFON AB LM ERICSSON (PUBL)
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although advances in video compression technology are accelerating, there are still gaps in the field of 360 video delivery and display in terms of effectively managing bandwidth in today's network environment, thus requiring further innovation as described below

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for providing 360 degrees immersive video based on gaze vector information
  • System and method for providing 360 degrees immersive video based on gaze vector information
  • System and method for providing 360 degrees immersive video based on gaze vector information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0189] Example Embodiment 1. A method operating in an immersive video optimization system, the method comprising:

[0190] Gaze vectors are received from a client device operating to display a 360° immersive video asset to a user, wherein each video frame includes an array of tiles projected onto a 3-dimensional (3D) display environment viewed by the user, the user immersing In this 3D display environment, the gaze vector defines the gaze direction that the user is viewing at any given time in the 3D display environment; determines the angular separation between the gaze vector and the direction vector, which is related to the tile in the 3D display environment respectively each tile position corresponding to the array is associated; and responsive to the angular interval, determining a plurality of tile weights corresponding to the array of tiles for use in selecting tiles of different bitrate qualities for the 360° immersive video asset , to assemble the video frames to be d...

Embodiment 2

[0191] Example embodiment 2. The method of claim 1 , wherein the gaze direction is obtained by tracking the orientation of a user's headset associated with the client device used to display the 360° immersive video asset.

Embodiment 3

[0192] Example embodiment 3. The method of claim 1 , wherein the gaze direction is obtained by tracking the movement of the user's eyeballs relative to different parts of the 3D display environment while displaying the 360° immersive video asset.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A system and method for providing immersive video based on gaze vector information. A gaze vector is obtained from a client device operating to display a 360o immersive video asset to a user, whereineach video frame comprises an array of tiles projected on a 3-dimensional (3D) display environment viewed by the user in which the user is immersed, the gaze vector defining a gaze direction in the 3Ddisplay environment where the user is viewing at any particular time. An angular separation is determined between the gaze vector and a directional vector associated with each tile location respectively corresponding to the array of tiles in the 3D display environment. Responsive to the angular separations, a plurality of tile weights corresponding to the array of tiles are determined for use inselecting tiles of different bitrate qualities of the 360o immersive video asset in order to facilitate the assembly of a video frame having different qualities across the 360-degree view to be delivered to the client device.

Description

technical field [0001] The present disclosure generally relates to communication networks. More specifically, and without limitation in any way, the present disclosure relates to systems and methods for providing 360° immersive video based on gaze vector information in a streaming network environment. Background technique [0002] In addition to improving several existing technologies, the introduction of virtual reality has brought new applications to the forefront. An improvement over existing technologies can be seen in the case of 360° immersive video (also variously known as panorama video, 360 degree video, or 360 video, etc.). [0003] 360-degree video provides users with an immersive "being there" experience. The enhanced immersion of virtual reality can be easily applied to video, providing a superior user experience compared to traditional video projected on a flat surface. Navigable 360-degree video systems are also becoming more popular with the advent of omni...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/383G06K9/32H04N5/232H04N13/332G02B27/00G06F3/01G06V10/24H04N23/698
CPCH04N21/2662H04N21/816H04N21/21805H04N21/44218H04N21/6587H04N21/26258H04N13/307H04N23/698H04N13/161H04N13/194H04N13/383H04N13/332
Inventor 克里斯·菲利普斯萨雷尔·科恩罗伯特·哈蒙德·福斯曼
Owner TELEFON AB LM ERICSSON (PUBL)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap