Real-Time Video Object Extraction for Virtual Scene Creation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video editing tools require user intervention and often fail to achieve accurate object detection and extraction, limiting their ability to create virtual situations in real-time.

Innovation Solution

A system and method that automatically extracts objects from videos in real-time, allowing users to select and place them into new frames, with a computing device and server-based module setup for object detection and frame manipulation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing video editing tools are used for object extraction, then user intervention is required and manual control is maintained, but the editing process becomes time-consuming and less efficient

Engineering Contradiction:
Improvevideo editing efficiencyVSAvoidautomatic object extraction
Core Design Contradiction:
ProductivityVSExtent of automation

Solution Approach 1:

The system enables automatic object extraction and frame manipulation without requiring continuous user intervention. The video processing module autonomously detects objects, extracts them from source frames, and places them into target frames, allowing the editing process to serve itself rather than requiring constant manual control.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary object detection and extraction actions automatically before the user needs to review or finalize the editing. By pre-processing the video frames to identify and isolate objects, the system reduces the time required for manual editing operations and improves overall productivity.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If existing video editing tools are used for object extraction, then manual control is maintained, but object detection and extraction accuracy deteriorates

Engineering Contradiction:
Improveobject detection accuracyVSAvoidmanual intervention requirement
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system replaces manual mechanical editing operations with automated computer vision-based object detection and extraction. The video processing module uses algorithmic methods to identify and isolate objects with high precision, substituting human manual control with automated computational processes that achieve superior detection accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If manual object extraction is performed, then user control over the process is maintained, but the complexity of the editing process increases

Engineering Contradiction:
Improveediting process complexityVSAvoidautomatic frame manipulation
Core Design Contradiction:
Device complexityVSExtent of automation

Solution Approach 1:

The system merges multiple separate editing operations (object detection, object extraction, frame selection, and object placement) into a single automated workflow. The video processing module combines these functions to manipulate objects between frames automatically, reducing the overall complexity of the editing process while maintaining high程度的 automation.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12190914B2System and method for extracting objects from videos in real-time to create virtual situations
Publication Date: 2025.01.07 SILVERLABS TECHNOLOGIES INC
  • US12190914B2 patent drawing
  • US12190914B2 patent drawing
  • US12190914B2 patent drawing

AI summary

Exemplary embodiments of present disclosure are directed towards a system and method for extracting objects from videos in real-time to create virtual situations, comprising a computing device comprises video creating and editing module configured to enable a user to record videos and select frames automatically from the user recorded videos thereby transferring the automatically selected frames from the computing device to a server. The server comprises video processing module configured receive the automatically selected frames thereby detecting and extracting objects from the automatically selected frames and transfer extracted objects to computing device and display the extracted objects to the user. The video creating and editing module configured to place the extracted objects on a new frame automatically and allow the user to reposition extracted objects on new frame and enable the user to customize the background and foreground elements in the new frame to create virtual situations.