Immersive Video Perspective Transition System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In immersive 360-degree video experiences, viewers adjusting the perspective away from the filmmaker's intended view can miss important aspects and require manual input to return, leading to a degraded user experience due to the lack of automatic and visually pleasing transitions back to the predetermined perspective.

Innovation Solution

Implementing a system that allows viewers to freely adjust the perspective within immersive video experiences while automatically returning to the filmmaker's defined path through a sequence of keyframes, using interpolation functions like spherical linear interpolation and quadratic easing, ensuring a seamless and visually appealing transition without further user input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If viewers are given control to adjust the perspective freely, then viewer freedom and exploration capability are improved, but the risk of missing important aspects and requiring manual input to return increases

Engineering Contradiction:
Improveviewer freedomVSAvoidmanual input requirement
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system automatically returns the viewport to the filmmaker's defined path without requiring manual user input. The automated return mechanism monitors when the viewport has drifted from the intended path and autonomously initiates the transition back, allowing the system to serve itself rather than requiring continuous user intervention.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors the viewport orientation and compares it against the filmmaker's defined path. When deviation is detected, the system provides feedback by automatically initiating a return transition, creating a closed-loop control system that maintains the intended viewing experience without user intervention.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If automatic return to filmmaker's perspective is implemented, then user experience is improved, but transition smoothness and visual appeal become critical requirements

Engineering Contradiction:
Improveautomatic returnVSAvoidtransition function complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The transition function dynamically adjusts the viewport orientation from the user-adjusted position back to the filmmaker's defined path. Rather than using a fixed, abrupt transition, the system employs dynamic interpolation that smoothly evolves the viewport orientation over time, creating a natural and visually pleasing return transition.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent employs spherical linear interpolation (slerp) for transitioning between orientations in 360-degree video. This curved interpolation method follows the spherical geometry of the immersive video space, creating smooth arc-shaped transitions that are visually pleasing and maintain spatial coherence, rather than using linear or angular interpolations that would create discontinuities.

Inventive Principle:
Principle #14Spheroidality (Curvature)

3Area of stationary object

If multiple cameras are used to capture 360-degree video, then panoramic coverage is improved, but stitching complexity and processing requirements increase

Engineering Contradiction:
Improvepanoramic coverageVSAvoidstitching complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The system merges multiple camera feeds into a single coherent 360-degree panoramic view through stitching. By combining the overlapping fields of view from multiple cameras and aligning them spatially, the system creates a unified immersive video experience that provides complete panoramic coverage while managing the complexity of coordinating multiple capture devices.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11765333B1Systems and methods for improved transitions in immersive media
Publication Date: 2023.09.19 APPLE INC
  • US11765333B1 patent drawing
  • US11765333B1 patent drawing
  • US11765333B1 patent drawing

AI summary

An immersive video experience can include a path between a plurality of keyframes selected by the filmmaker. A viewer can be given control of the view in the immersive video experience to provide the viewer freedom to look around and explore the scene. To improve user experience, after the user adjusts the perspective of the immersive video to depart from a filmmaker's defined perspective, the perspective can be returned to resume the filmmaker's defined perspective to avoid the viewer missing important parts of the immersive video. Additionally, the user experience can be improved by having the return from the user-adjusted perspective to the filmmaker's defined perspective include a visually pleasing transition that does not require further user input.