RTCP Viewport Feedback Control for Immersive Teleconferencing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current technologies face challenges in delivering immersive video with real-time viewpoint margin updates in immersive teleconferencing due to network overhead and server computational limitations, leading to delayed and inefficient video delivery.

Innovation Solution

A method and apparatus that utilize a processor to control video conference calls by setting timers and event-based thresholds for viewport orientation changes, allowing for efficient delivery of additional video margins based on spatial orientation changes, processing different packet lengths, and adjusting the frequency of RTCP feedback to minimize bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If real-time viewport margin updates are delivered for immersive video teleconferencing, then video quality and user experience are improved, but network overhead and server computational burden increase

Engineering Contradiction:

Improvevideo delivery qualityVSAvoidnetwork overhead

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent segments the viewport feedback mechanism into two distinct triggering modes: time-based triggering and event-based triggering. This segmentation allows the system to divide the continuous feedback process into discrete, manageable intervals and events, reducing the overall frequency and volume of feedback messages transmitted over the network while maintaining adequate video delivery quality.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements periodic time-based triggering where viewport margin updates are sent at predetermined time intervals rather than continuously. This periodic action reduces network overhead by eliminating redundant updates during stable viewing conditions while still providing regular refreshes to maintain video quality and synchronization.

Inventive Principle:

Principle #19Periodic action

2Measurement precision

If frequent RTCP feedback is sent for viewport orientation changes, then video delivery accuracy is improved, but network bandwidth consumption increases

Engineering Contradiction:

Improveviewport feedback accuracyVSAvoidbandwidth usage

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent implements dynamic triggering that adapts feedback frequency based on actual viewport conditions. The system transitions between time-based and event-based triggering modes depending on whether the viewport is stable or changing, optimizing the balance between feedback accuracy and bandwidth consumption for each specific viewing scenario.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent employs event-based triggering that activates RTCP feedback only when specific viewport events occur, such as orientation changes exceeding a threshold. This feedback mechanism ensures high measurement precision is maintained when needed while significantly reducing bandwidth consumption during stable viewing periods by eliminating unnecessary feedback transmissions.

Inventive Principle:

Principle #23Feedback

3Reliability

If continuous viewport monitoring is performed, then video synchronization is improved, but server computational overhead increases

Engineering Contradiction:

Improvevideo synchronizationVSAvoidserver computational overhead

Core Design Contradiction:

ReliabilityVSPower

Solution Approach 1:

The patent segments continuous monitoring into discrete monitoring intervals triggered by time-based or event-based conditions. This segmentation allows the server to perform computational checks only at relevant moments rather than continuously, reducing computational overhead while maintaining adequate synchronization through periodic and event-driven verification points.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements periodic time-based triggering for viewport monitoring, where synchronization checks are performed at predetermined time intervals. This periodic action reduces server computational overhead by eliminating continuous monitoring while still providing regular synchronization updates to maintain video delivery reliability and coordination.

Inventive Principle:

Principle #19Periodic action

4Ease of operation

If rapid viewport changes are responded to immediately, then user experience is improved, but network latency increases

Engineering Contradiction:

Improveuser experienceVSAvoidnetwork latency

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The patent implements dynamic triggering that responds to rapid viewport changes through event-based triggering when orientation changes exceed a threshold. This dynamic response provides timely updates for significant user actions, improving user experience by maintaining video relevance during active viewing changes while avoiding the latency associated with continuous immediate response mechanisms.

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS11711492B2Signaling of the RTCP viewport feedback for immersive teleconferencing and telepresence for remote terminals

Publication Date: 2023.07.25 TENCENT AMERICA LLC

AI summary

There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform controlling a delivery of a video conference call to a viewport, setting a timer and an event-based threshold with respect to the video conference call, determining whether any of the timer and the event-based threshold have been triggered based on any of an elapsed time and an event, and further controlling the delivery of the video conference call to the viewport based on determining whether any of the timer and the event-based threshold have been triggered.