Dynamic View-Specific Filter Parameters for 360-Degree Video

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional immersive-video systems face issues with inconsistent and inflexible rendering of 360-degree videos, particularly in adjusting light exposure and visual effects as the viewer's orientation changes, leading to poor light exposure and unnatural color gradients.

Innovation Solution

A dynamic-video-view system that detects the field of view and interpolates filter parameters from spatial keyframes to generate view-specific-filter parameters, allowing for real-time adjustment of color grading, blur filtering, and other visual effects based on the viewer's orientation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional immersive-video systems use fixed filter parameters in video files, then file format simplicity is maintained, but visual effects consistency and adaptability to different viewing orientations deteriorate

Engineering Contradiction:
Improvevisual effects adaptabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies dynamics by transitioning from static filter parameters embedded in video files to dynamic filter parameters generated in real-time based on the viewer's orientation. The system continuously adjusts color grading, exposure, and other visual effects parameters according to the current viewing angle and orientation, making the visual experience adaptive rather than fixed.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements parameter changes by modifying filter parameters dynamically based on viewing conditions. Instead of using fixed parameters, the system changes parameters such as color grading values, exposure levels, and visual effect intensities according to the viewer's orientation and the specific frame being viewed, enabling adaptability without requiring complete system restructuring.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If fixed color-grading values are embedded in video frames, then rendering speed is improved, but visual effects naturalness and lighting consistency deteriorate

Engineering Contradiction:
Improverendering speedVSAvoidlighting consistency
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-processing video content to identify spatial keyframes and their associated filter parameters before playback. During rendering, the system quickly retrieves and applies the appropriate pre-determined parameters based on the current viewing orientation, maintaining fast rendering speed while ensuring lighting consistency through pre-analyzed keyframe data.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses an intermediary approach by introducing a parameter generation system that acts as a mediator between the fixed video content and the dynamic viewing conditions. This intermediary generates appropriate filter parameters in real-time based on the viewer's orientation, bridging the gap between static content and dynamic requirements without sacrificing rendering speed.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If color-grading values are adjusted based on other frames, then visual effects customization is improved, but unnatural color gradients and distracting effects are introduced

Engineering Contradiction:
Improvevisual effects customizationVSAvoidunnatural color gradients
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by adjusting filter parameters specifically for each spatial keyframe based on its local characteristics and the current viewing orientation, rather than applying uniform adjustments across all frames. This localized approach ensures that color grading and visual effects are customized appropriately for each view while maintaining natural appearance and avoiding distracting artifacts.

Inventive Principle:
Principle #3Local quality

4Ease of manufacture

If rigid file formats are used, then system simplicity is maintained, but editing flexibility and visual effects customization deteriorate

Engineering Contradiction:
Improveediting flexibilityVSAvoidsystem complexity
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The patent applies segmentation by separating the video content from its associated filter parameters, organizing parameters by spatial keyframes. This segmentation allows independent editing and manipulation of visual effects parameters without affecting the underlying video content, providing editing flexibility while maintaining a manageable system structure through organized parameter groups.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11539932B2Dynamically generating and changing view-specific-filter parameters for 360-degree videos
Publication Date: 2022.12.27 ADOBE INC
  • US11539932B2 patent drawing
  • US11539932B2 patent drawing
  • US11539932B2 patent drawing

AI summary

This disclosure relates to methods, non-transitory computer readable media, and systems that generate and dynamically change filter parameters for a frame of a 360-degree video based on detecting a field of view from a computing device. As a computing device rotates or otherwise changes orientation, for instance, the disclosed systems can detect a field of view and interpolate one or more filter parameters corresponding to nearby spatial keyframes of the 360-degree video to generate view-specific-filter parameters. By generating and storing filter parameters for spatial keyframes corresponding to different times and different view directions, the disclosed systems can dynamically adjust color grading or other visual effects using interpolated, view-specific-filter parameters to render a filtered version of the 360-degree video.