Video Background Removal via Color Block Variance Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for removing the background from videos are complex and require frame-by-frame processing, making them inefficient for dynamic backgrounds and requiring post-production, especially when using green screens or single-colored backgrounds.

Innovation Solution

A method that analyzes pixel correlation to separate foreground and background by forming color blocks, computing variance between frames, and identifying the target object's contour, allowing for automatic background removal and creation of a video clip with a transparent background.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional frame-by-frame background removal is used, then background can be removed from video, but processing time and computational resources increase significantly

Engineering Contradiction:
Improvebackground removal accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the video processing task by dividing frames into multiple color blocks based on color similarity, then processes each block independently using motion variance analysis. This segmentation allows parallel processing and reduces the computational burden compared to analyzing every pixel in every frame sequentially.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-classifying pixels into color blocks and pre-calculating motion variances for each block before actual background removal. This preliminary organization of data structures and computations enables faster processing during the actual background extraction phase.

Inventive Principle:
Principle #10Preliminary action

2Ease of manufacture

If green screen or single-colored background is used, then background removal is easier, but production complexity and post-production requirements increase

Engineering Contradiction:
Improvebackground removal easeVSAvoidproduction complexity
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The patent enables the system to automatically perform background removal without requiring manual green screen setup or post-production intervention. The motion-based algorithm self-adapts to separate foreground from background by analyzing temporal variations, making the process autonomous and eliminating the need for specialized production equipment or manual editing.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent changes the parameter basis for background removal from color-based (green screen) to motion-based (temporal variance). By shifting from static color thresholding to dynamic motion analysis, the system removes backgrounds from natural scenes without requiring controlled filming conditions or post-production color keying.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If motion-based color block analysis is used, then processing speed improves, but handling complex dynamic backgrounds becomes more difficult

Engineering Contradiction:
Improveprocessing speedVSAvoiddynamic background handling
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by making the background removal process adaptive to temporal changes. The system continuously analyzes motion patterns across frames and dynamically adjusts color block classifications based on observed variance patterns. This dynamic approach enables the algorithm to distinguish between moving foreground objects and dynamic backgrounds by analyzing temporal consistency of motion patterns.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9934439B1Method, system for removing background of a video, and a computer-readable storage device
Publication Date: 2018.04.03 FRAMY INC
  • US9934439B1 patent drawing
  • US9934439B1 patent drawing
  • US9934439B1 patent drawing

AI summary

The disclosure is related to a method and a system for removing background of a video. One of the objectives of the method and system is to extract a motion image object from a video. In the method, a plurality of frames is first retrieved from the video. An image processing approach is performed to recognize image features of every frame. A plurality of color blocks for every frame are obtained through the image processing scheme. A variance among the pixels in every color block of two continuous frames can be obtained by a comparison computation, so as to form a color block variance. The color block variance allows the system to determine a motion target object as well as its image contour. The blocks excepting the blocks of the target object are set as transparent blocks. Therefore the background relative to the target object can be removed.