Streaming Media Server Viewpoint Prediction Bandwidth Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for delivering interactive content are inefficient in providing a seamless transition between passive high-definition video and interactive game experiences, often requiring excessive bandwidth and interaction, which can be tiring for older adults, and struggle with latency issues due to inadequate prefetching techniques.

Innovation Solution

A method and system that determine the likelihood of viewpoint movement between view regions and send renderable graphics information only when the likelihood exceeds a threshold, using a server to preprocess and send delta-PVS (potentially visible set) data packets, including advertising, based on user input and available bandwidth, to optimize content streaming.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If prefetching is used to reduce latency, then latency is reduced, but bandwidth usage increases

Engineering Contradiction:
ImprovelatencyVSAvoidbandwidth usage
Core Design Contradiction:
Loss of timeVSQuantity of substance

Solution Approach 1:

The system performs preliminary actions by prefetching graphics information packets to a cache memory before they are actually needed for rendering. The server predicts future viewpoint positions and pre-sends corresponding graphic elements, so that when the viewpoint actually reaches those positions, the data is already available in cache, reducing latency without requiring continuous high-bandwidth transmission during active viewing.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If all graphics information is sent to ensure high-definition quality, then quality is maintained, but bandwidth consumption increases

Engineering Contradiction:
ImprovequalityVSAvoidbandwidth consumption
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The system applies local quality by sending high-definition graphics information only for the specific regions of interest (viewcells) that are predicted to be viewed, rather than uniformly transmitting all possible graphic elements. The server determines which viewcells are likely to be accessed based on predicted viewpoint movement, and prioritizes transmission of those specific regions, maintaining quality where needed while reducing overall bandwidth consumption.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If interactive control is provided, then user engagement is improved, but system complexity increases

Engineering Contradiction:
Improveuser engagementVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system introduces an intermediary prediction mechanism that mediates between user input and content delivery. Instead of directly responding to all user interactions in real-time, the system uses viewpoint prediction algorithms as an intermediary layer that anticipates user navigation choices and pre-preps content accordingly. This reduces the complexity of real-time processing while maintaining interactive engagement, as the prediction system handles the complexity of deciding what content to prepare next.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3543958A1System and method of delivering and controlling streaming interactive media comprising predetermined packets of geometric, texture, lighting and other data which are rendered on a receiving device
Publication Date: 2019.09.25 JENKINS BARRY LYNN
  • EP3543958A1 patent drawingFigure 1
  • EP3543958A1 patent drawingFigure 2
  • EP3543958A1 patent drawingFigure 3

AI summary

In an exemplary embodiment, a method, conducted on a server, sends renderable graphics information to a client device, said graphics information including at least one set of graphics information visible from a second view region and not visible from a first view region. The method includes determining a likelihood that a viewpoint undergoes movement from said first view region to said second view region. The method further includes sending said at least one set of graphics information upon determination that the likelihood that the viewpoint undergoes movement from said first view region to said second view region is greater than a predetermined threshold, said movement determined according to a predetermined motion path.