Omnidirectional Viewpoint Grouping for VR Content

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality audiovisual content streaming systems limit users to a single observation point, restricting their viewing experience and freedom, especially when the initial point may be distant or poorly positioned relative to the event of interest.

Innovation Solution

A method and apparatus that enable signaling and storage of multiple viewpoints for omnidirectional audiovisual content, allowing users to switch between observation points by categorizing them into spatially or logically related groups, with default and origin points, and associating them with specific orientations, tracks, and metadata, to enhance user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a single observation point is used in virtual reality content playback, then the system complexity is reduced and the content structure is simplified, but the user experience is limited and the viewing flexibility is reduced

Engineering Contradiction:
Improveviewing flexibilityVSAvoidcontent structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the virtual reality content into multiple observation point groups, where each group contains multiple observation points with different spatial positions and orientations. This segmentation allows the content to be divided into manageable units that can be selectively activated, providing viewing flexibility while maintaining structured organization through grouping hierarchies.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal content structure that can accommodate multiple observation points and groups within a single VR content package. This multi-functional framework allows the same content to be viewed from different perspectives and positions, making the system adaptable to various viewing preferences without requiring separate content files for each observation point.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple observation points are supported in virtual reality content, then the user experience is enhanced and viewing flexibility is improved, but the content complexity and processing requirements increase

Engineering Contradiction:
Improveobservation point varietyVSAvoidcontent structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent organizes multiple observation points into discrete groups, where each group represents a coherent set of related viewing positions. This segmentation allows the system to manage complexity by handling observation points in manageable units rather than as a monolithic structure, enabling selective activation of specific groups based on content requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a dynamic observation point selection mechanism that allows the playback system to adaptively choose which observation points to activate based on user preferences, content characteristics, and device capabilities. This dynamic approach enables the system to scale the level of complexity according to actual needs, activating only the necessary observation points rather than processing all possible viewpoints simultaneously.

Inventive Principle:
Principle #15Dynamics

3Reliability

If multiple observation points with different orientations are implemented, then the immersion quality is improved and the alignment with viewer position is enhanced, but the rendering complexity and computational requirements increase

Engineering Contradiction:
Improvecontent alignment accuracyVSAvoidrendering operation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by associating specific observation orientations with specific observation points within each group. Each observation point is configured with tailored orientation parameters that are optimized for its particular spatial position and the content it is intended to view. This localized optimization ensures high alignment accuracy for each viewpoint while avoiding the need to compute all possible orientations for all observation points.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamic orientation adjustment where the playback system selects and activates only the observation points and orientations that are relevant to the current playback context. This dynamic selection reduces computational requirements by avoiding the rendering of unnecessary viewpoints and orientations, while still maintaining high alignment accuracy for the activated observation points.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3777219B1Method and apparatus for signaling and storage of multiple viewpoints for omnidirectional audiovisual content
Publication Date: 2024.05.01 NOKIA TECHNOLOGIES OY
  • EP3777219B1 patent drawingFigure 1
  • EP3777219B1 patent drawingFigure 2
  • EP3777219B1 patent drawingFigure 3

AI summary

A method, apparatus and computer program product are provided for the rendering of audiovisual content, such as 360-degree virtual reality content, in a manner that allows for signaling and storage for multiple viewpoints and observation points. In particular, implementations are presented that allow for grouping each viewpoint/observation point logically and/or spatially such that each viewpoint/observation point can be traversed by a user at any time to consume audiovisual content from different locations.