Spherical Region of Interest Rendering via Timed Directorial Cues

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality technologies face challenges in effectively rendering and displaying three-dimensional environments with timed directorial information, particularly in specifying and maintaining a region of interest within a spherical surface, which affects user experience and immersion.

Innovation Solution

An apparatus and method that include an interface circuit and image generating circuit to receive and process media data with timed directorial information, generating images based on this information to display a region of interest on a sphere surface, using great circles to define boundaries and provide viewpoint and field of view details.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If traditional viewport techniques are used for small-screen display, then the screen can display the content, but the detail perception and immersion experience deteriorate

Engineering Contradiction:
Improvedisplay screen areaVSAvoiddetail perception
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent transitions from traditional 2D screen display to spherical coordinate system (latitude and longitude dimensions) for defining regions of interest. By mapping the spherical media data onto a sphere surface and defining ROIs using spherical coordinates (latitude range and longitude range), the system enables immersive 360-degree viewing experience while maintaining detail perception on small screens through selective region rendering.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If the entire spherical environment is rendered, then complete immersion is achieved, but the processing complexity and data transmission load increase

Engineering Contradiction:
Improveimmersion experienceVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts and renders only the relevant region of interest from the complete spherical environment based on timed directorial information. Instead of rendering the entire 360-degree spherical media data, the system identifies the specific latitude and longitude ranges that contain the region of interest and renders only those portions, significantly reducing processing complexity and data transmission requirements while maintaining immersion through proper spherical projection.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary identification of regions of interest during the media encoding stage, embedding timed directorial information (latitude ranges, longitude ranges, and time stamps) into the media data. This allows the playback device to pre-know which regions to render at specific times, avoiding the need for real-time analysis of the entire spherical environment and reducing processing complexity during playback.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If manual control is given to users for exploring the environment, then user freedom is improved, but the ability to follow directed plot elements deteriorates

Engineering Contradiction:
Improveuser freedomVSAvoidplot element focus
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent implements dynamic control of the region of interest based on timed directorial information while preserving user freedom. The system automatically adjusts the ROI boundaries (latitude and longitude ranges) according to pre-defined directorial cues at specific time points, guiding users to important plot elements. Users can still manually explore the environment when not in directed regions, creating a dynamic balance between guided viewing and user freedom.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3453170B1Method and apparatus for signaling region of interests
Publication Date: 2023.07.05 MEDIATEK INC
  • EP3453170B1 patent drawingFigure 1
  • EP3453170B1 patent drawingFigure 2
  • EP3453170B1 patent drawingFigure 3

AI summary

Aspects of the disclosure provide an apparatus that includes an interface circuit, an image generating circuit and a display device. The interface circuit is configured to receive media data with timed directorial information indicative of a region of interests at a time. The image generating circuit is configured to extract the timed directorial information, and generate one or more images of the region of interests based on the media data and the timed directorial information. The display device is configured to display the one or more images at the time.