Volumetric Video Viewpoint Selection and Trajectory Rendering

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Volumetric video systems face challenges in efficiently combining multiple viewpoints and rendering immersive, interactive content due to their data-heavy nature, requiring the automatic selection of viewpoint characteristics and trajectories to enhance viewer experience while accommodating different artistic styles and display formats.

Innovation Solution

A system and method for automatically selecting viewpoint characteristics and trajectories in volumetric video presentations by receiving multiple video streams, identifying desired characteristics, determining consistent trajectories, and rendering volumetric video traversals through compositing, allowing for personalized and stylistically varied renderings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple video streams from different viewpoints are combined to create immersive volumetric video, then the viewer experience becomes more immersive and interactive, but the data volume and processing complexity increase significantly

Engineering Contradiction:

Improveviewing flexibilityVSAvoidrendering complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the volumetric video data by organizing multiple video streams from different viewpoints into discrete, manageable units. Each video stream representing a specific viewpoint is processed and selected independently based on traversal requirements, dividing the complex rendering task into smaller, manageable segments that can be composited efficiently

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system dynamically selects viewpoint characteristics and trajectories based on real-time traversal requirements. The viewpoint selection is not static but adapts dynamically to the desired traversal path through the scene, allowing the system to optimize which video streams to use for each segment of the traversal, thereby managing complexity while maintaining versatility

Inventive Principle:

Principle #15Dynamics

2Productivity

If automatic selection of viewpoint characteristics is implemented to simplify the rendering process, then the rendering efficiency improves, but the ability to maintain different artistic styles may be compromised

Engineering Contradiction:

Improverendering efficiencyVSAvoidartistic style variety

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary identification and categorization of viewpoint characteristics from multiple video streams before the actual rendering process. By pre-analyzing and organizing the available viewpoints according to their characteristics, the system prepares the data in advance, enabling efficient automatic selection during rendering while preserving the diversity of artistic styles through pre-categorized options

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system maintains artistic style variety by adjusting and selecting different viewpoint parameters (such as camera position, angle, focal length) automatically. By changing these parameters based on pre-identified characteristics, the system can efficiently generate traversals that mimic different artistic styles without manual intervention, thus maintaining both rendering efficiency and stylistic versatility

Inventive Principle:

Principle #35Parameter changes

3Adaptability or versatility

If multiple video streams are composited to render volumetric video traversals, then the viewer personalization options increase, but the processing time and computational resources required increase

Engineering Contradiction:

Improvepersonalization optionsVSAvoidprocessing time

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The compositing process is segmented into discrete steps where individual video streams are selected and combined based on pre-identified viewpoint characteristics. This segmentation allows the system to process only the necessary video streams for each specific traversal rather than processing all available streams, reducing processing time while maintaining personalization options

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs preliminary identification of suitable video streams and their characteristics before the compositing operation. By preparing and organizing the video stream selections in advance, the actual compositing process requires less computational time, enabling personalized traversals to be generated efficiently without sacrificing viewer customization options

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11470297B2Automatic selection of viewpoint characteristics and trajectories in volumetric video presentations

Publication Date: 2022.10.11 AT&T INTELLECTUAL PROPERTY I L P

AI summary

A method for automatic selection of viewpoint characteristics and trajectories in volumetric video presentations includes receiving a plurality of video streams depicting a scene, wherein the plurality of video streams provides images of the scene from a plurality of different viewpoints, identifying a set of desired viewpoint characteristics for a volumetric video traversal of the scene, determining a trajectory through the plurality of video streams that is consistent with the set of desired viewpoint characteristics, rendering a volumetric video traversal that follows the trajectory, wherein the rendering comprises compositing the plurality of video streams, and publishing the volumetric video traversal for viewing on a user endpoint device.