Pre-encoding Objects for 360-Degree Video Latency

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In 360-degree video streaming, sending the entire video is bandwidth-intensive, and rendering new objects that suddenly enter the scene can be problematic due to insufficient bandwidth, leading to poor video quality if only partial video of the viewable area is sent.

Innovation Solution

Pre-encoding objects of interest in a sideband using unused bandwidth, allowing for efficient rendering when they enter the viewport, thereby maintaining video quality and user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If only partial video of the viewable area is sent to save bandwidth, then bandwidth consumption is reduced, but video quality deteriorates when new objects enter the scene

Engineering Contradiction:

Improvebandwidth consumptionVSAvoidvideo quality

Core Design Contradiction:

Loss of energyVSReliability

Solution Approach 1:

The system performs preliminary encoding of objects that may enter the viewport in the future. By pre-encoding these objects in a sideband using unused bandwidth, the system ensures that when objects suddenly enter the scene, they are already prepared and can be rendered immediately without compromising video quality or requiring additional bandwidth during playback

Inventive Principle:

Principle #10Preliminary action

2Reliability

If the entire 360-degree video is sent to maintain video quality, then video quality is preserved, but bandwidth consumption increases

Engineering Contradiction:

Improvevideo qualityVSAvoidbandwidth consumption

Core Design Contradiction:

ReliabilityVSLoss of energy

Solution Approach 1:

The video content is segmented into two parts: the main viewable area video and a sideband containing pre-encoded objects. This segmentation allows the system to send only the necessary portions - the current viewport content plus pre-encoded objects that may enter - thereby reducing overall bandwidth consumption while maintaining video quality when objects appear

Inventive Principle:

Principle #1Segmentation

3Reliability

If bandwidth is allocated for rendering new objects when they enter, then video quality is maintained, but latency increases due to insufficient pre-processing

Engineering Contradiction:

Improverendering qualityVSAvoidrendering latency

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

Objects are pre-encoded and prepared in advance during periods of unused bandwidth. This preliminary action ensures that when objects suddenly enter the viewport, they are already processed and ready for immediate rendering, eliminating rendering latency and maintaining smooth video playback without quality compromise

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11800232B2Object pre-encoding for 360-degree view for optimal quality and latency

Publication Date: 2023.10.24 INTEL CORP

AI summary

Systems, apparatuses and methods may provide for technology to improve an appearance of objects that enter a viewable area of a 360-degree video. The technology may include a head mounted display (HMD), a viewport comprising a viewable area within the HMD, and a memory to store objects of interest not currently in the viewable area.