Dynamic Object Suppression Key for Realistic Video Graphics

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional occlusion techniques fail to properly integrate virtual graphics into video streams with complex backgrounds, leading to unrealistic appearances due to inconsistent color signatures and movement, especially in environments like sporting events with varying spectator colors.

Innovation Solution

A suppression key generation system that analyzes video scenes to detect dynamic objects and generates suppression keys, allowing for the proper placement and integration of virtual graphics by suppressing regions and extracting foreground objects, enabling realistic overlays even in complex backgrounds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If conventional occlusion techniques are used to integrate virtual graphics into video streams, then the process is simple and fast, but the integration becomes unrealistic when backgrounds are complex and dynamically varying

Engineering Contradiction:

Improveease of graphics integrationVSAvoidrealism of graphics integration

Core Design Contradiction:

Ease of manufactureVSReliability

Solution Approach 1:

The system dynamically adapts the occlusion model by detecting motion vectors and spatial patterns in real-time. Instead of using a static background model, the system continuously updates the suppression key based on detected object motion and background variations, enabling the graphics to maintain realistic occlusion relationships even when the background is dynamically changing

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent replaces traditional chroma keying and manual roto-scoping methods with automated computer vision techniques. The system uses motion vector analysis, spatial pattern recognition, and machine learning algorithms to automatically generate suppression keys, eliminating the need for manual operations and traditional color-based separation methods

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If chroma keying techniques are used to handle occluding foreground objects, then consistently colored backgrounds can be processed effectively, but the method fails when backgrounds have complex color variations

Engineering Contradiction:

Improveocclusion handling accuracyVSAvoidadaptability to complex backgrounds

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system segments the background into multiple regions based on spatial patterns and color ranges. Instead of treating the background as a uniform color field, the system divides it into distinct zones that can be processed independently, allowing for accurate occlusion handling in regions with complex color variations while maintaining simplicity in uniformly colored regions

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system changes the parameter space from color-only analysis to a multi-dimensional feature space that includes spatial position, motion vectors, and temporal patterns. This parameter transformation enables the system to distinguish between foreground objects and background regions even when color information is insufficient or ambiguous

Inventive Principle:

Principle #35Parameter changes

3Measurement precision

If spatial patterns or warping of capture images are used to model backgrounds with complex detail, then background modeling improves, but alignment issues arise and the approach becomes problematic when the background varies

Engineering Contradiction:

Improvebackground modeling precisionVSAvoidcomplexity of background modeling

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system incorporates feedback mechanisms where detected motion vectors and spatial patterns are continuously used to refine the suppression key. The feedback loop allows the system to automatically adjust the background model based on actual scene content, improving alignment accuracy while reducing the need for complex manual configuration

Inventive Principle:

Principle #23Feedback

4Measurement precision

If post-production approaches such as roto-scoping are employed to define object boundaries, then accurate segmentation is achieved, but the process becomes time consuming and limited to pre-produced content

Engineering Contradiction:

Improveobject boundary definition accuracyVSAvoidtime required for processing

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary detection and classification of objects and background regions in real-time during the video stream processing. By pre-computing motion vectors, spatial patterns, and suppression keys before the actual graphics integration, the system eliminates the need for time-consuming post-production manual operations while maintaining high segmentation accuracy

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS8922718B2Key generation through spatial detection of dynamic objects

Publication Date: 2014.12.30 DISNEY ENTERPRISES INC

AI summary

A method, apparatus, and computer program product are described that utilizes spatial modeling to represent foreground objects of an event to allow virtual graphics to be integrated into a background of the event in the presence of dynamic objects. The present invention detects a presence of dynamic objects within a region of interest from a video depicting the event. The present invention produces a suppression key corresponding to the dynamic object when present in the video or a suppression key with a default value when and where no dynamic object is present in the video.