Adaptive Multi-Direction Video Format Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern coding protocols for multi-directional images are inefficient as they allocate space in a fixed manner, leading to wastage of resources since many applications only utilize a portion of the image during rendering.

Innovation Solution

Implementing organizational configurations for multi-directional video that allow for format switching during a coding session, where source images can be assigned different formats, and video coders and decoders transform reference frames to achieve predictive coding and decoding, optimizing resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If fixed space allocation is used in multi-directional images, then coding simplicity is maintained, but resource efficiency deteriorates due to wasted bandwidth on unused portions

Engineering Contradiction:
Improvecoding simplicityVSAvoidbandwidth consumption
Core Design Contradiction:
Ease of manufactureVSLoss of energy

Solution Approach 1:

The patent implements dynamic format switching that allows the multi-directional video format to change during a coding session based on which field of view is currently being viewed. This enables the allocation of image space to dynamically match the actual viewing requirements, eliminating the waste of bandwidth on unused portions while maintaining coding efficiency through standardized format transitions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the organizational configuration parameters of the multi-directional video format by switching between different format configurations (e.g., from a first format to a second format). This parameter switching allows the system to adapt the spatial allocation of different fields of view according to current viewing needs, optimizing bandwidth usage without requiring completely different coding approaches.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If all portions of multi-directional image are coded at high resolution, then image quality is maintained, but bandwidth consumption increases due to transmission of unused regions

Engineering Contradiction:
Improveimage qualityVSAvoidbandwidth consumption
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent extracts and transmits only the relevant field of view portions that are actually being viewed by the user. By switching formats to match the current viewing direction, the system extracts and transmits only the necessary image data at high resolution, while leaving unused portions uncoded or minimally coded, thus reducing overall bandwidth consumption while maintaining quality for the viewed regions.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different quality levels to different portions of the multi-directional image based on their current relevance. The viewed field of view receives high-resolution coding and transmission, while unviewed portions use lower resolution or are excluded from transmission entirely. This local quality differentiation maintains image quality where needed while reducing total bandwidth consumption.

Inventive Principle:
Principle #3Local quality

3Productivity

If format switching is implemented during coding session, then resource allocation efficiency is improved, but system complexity increases due to transformation requirements

Engineering Contradiction:
Improvecoding efficiencyVSAvoidtransformation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements a universal format switching mechanism that can transition between multiple different organizational configurations of multi-directional video. The same coding and decoding infrastructure handles all format transitions, making the system multi-functional capable of adapting to different viewing scenarios without requiring separate specialized systems for each format, thus managing complexity while maintaining high coding efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent performs preliminary format switching and reference frame transformation before the actual coding process begins for each segment. By pre-configuring the appropriate format and transforming reference frames in advance, the system reduces the complexity during the main coding operation, as the transformation work is already completed and the coding process can proceed with the pre-prepared format.

Inventive Principle:
Principle #10Preliminary action

4Ease of operation

If fixed format is used for multi-directional video, then decoding simplicity is maintained, but adaptability to different viewing scenarios deteriorates

Engineering Contradiction:
Improvedecoding simplicityVSAvoidadaptability to viewing scenarios
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent makes the video format dynamic by allowing switches between different organizational configurations during the coding and decoding session. This dynamic format adaptation enables the decoding process to match the current viewing scenario automatically, improving versatility while maintaining relative decoding simplicity through standardized transformation procedures that follow predictable patterns.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10754242B2Adaptive resolution and projection format in multi-direction video
Publication Date: 2020.08.25 APPLE INC
  • US10754242B2 patent drawing
  • US10754242B2 patent drawing
  • US10754242B2 patent drawing

AI summary

Techniques are described for implementing format configurations for multi-directional video and for switching between them. Source images may be assigned to formats that may change during a coding session. When a change occurs between formats, video coders and decoder may transform decoded reference frames from the first format to the second format. Thereafter, new frames in the second configuration may be coded or decoded predictively using transformed reference frame(s) as source(s) of prediction. In this manner, video coders and decoders may use intra-coding techniques and achieve high efficiency in coding.