VR Video Viewport Rendering with Dynamic Syntax Elements

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current VR video technologies face challenges in efficiently signaling and rendering preferred regions-of-interest or viewports, particularly in adjusting these regions to fit the size and aspect ratio of a user's display, which can impact the user experience and video quality.

Innovation Solution

The technique involves generating and signaling syntax elements that indicate preferred rendering operations for preferred regions-of-interest or viewports in VR video data, allowing for dynamic adjustment and rendering to fit the display, including options to maintain aspect ratio, crop, or add banners, ensuring optimal viewing experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If preferred regions-of-interest or viewports are adjusted to fit display size and aspect ratio, then rendering efficiency and user experience are improved, but video quality and content integrity may deteriorate

Engineering Contradiction:

Improverendering efficiencyVSAvoidvideo quality

Core Design Contradiction:

ProductivityVSManufacturing precision

Solution Approach 1:

The patent implements dynamic rendering operations that adjust the rendering approach based on syntax elements indicating user preferences. The system can dynamically switch between maintaining aspect ratio, cropping, or adding banners based on the specific viewport configuration and user settings, allowing optimal balance between rendering efficiency and video quality for each situation

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent applies different rendering strategies to different regions of the video content based on syntax elements that identify preferred regions-of-interest. By focusing high-quality rendering on important regions while using more efficient rendering for less critical areas, the system achieves overall video quality preservation while maintaining rendering efficiency

Inventive Principle:

Principle #3Local quality

2Adaptability or versatility

If syntax elements indicating preferred rendering operations are signaled, then rendering flexibility and adaptability are improved, but data transmission complexity increases

Engineering Contradiction:

Improverendering flexibilityVSAvoiddata transmission complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent signals preferred rendering operations using syntax elements that provide just enough information to enable flexible rendering without overwhelming data transmission. Rather than transmitting complete rendering instructions for all possible scenarios, the system uses concise syntax elements that indicate preferred operations, achieving rendering flexibility with minimal additional data overhead

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentEP3556100B1Preferred rendering of signalled regions-of-interest or viewports in virtual reality video

Publication Date: 2023.01.18 QUALCOMM INC

Figure 1
Figure 2
Figure 3

AI summary

A method of processing video data includes receiving 360-degree video data, receiving one or more first syntax elements indicating preferred regions-of-interest or preferred viewports of the 360-degree video data, receiving one or more second syntax elements that indicate a preferred rendering operation for rendering the preferred regions-of-interest or preferred viewports, and rendering the 360-degree video data based on the preferred rendering operations.