Superimposing Prerecorded Media Over Live Video Using Depth Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile electronic devices lack the capability to enhance user interaction with the physical environment by seamlessly integrating prerecorded media files into live video feeds, failing to provide a rich and interactive experience.

Innovation Solution

The method involves superimposing prerecorded media files, such as GIFs or other video formats, over live video on mobile devices, using depth information to position them accurately within the scene, allowing for interactive and visually integrated content that enhances the user's experience without obscuring important visual elements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If prerecorded media files are superimposed over live video, then user interaction with the physical environment is enhanced, but the device complexity increases

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by capturing depth information and analyzing the live video feed before superimposing prerecorded media files. This allows the system to pre-determine positioning and integration parameters, reducing real-time processing complexity while maintaining enhanced user interaction capabilities.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces depth information as an intermediary element that mediates between the live video feed and prerecorded media files. This intermediary data layer enables accurate positioning and integration without requiring complex direct processing between the video and media files, thus reducing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Stability of the object's composition

If prerecorded media files are positioned using depth information, then visual integration into the scene is improved, but measurement precision requirements increase

Engineering Contradiction:
Improvevisual integrationVSAvoiddepth information accuracy
Core Design Contradiction:
Stability of the object's compositionVSMeasurement precision

Solution Approach 1:

The system applies local quality by using depth information specifically at key positioning points within the scene rather than requiring uniform high precision across the entire video feed. This allows visual integration to be achieved with targeted depth measurements at critical locations, reducing overall measurement precision requirements.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11057601B2Superimposing a prerecorded media file into a video
Publication Date: 2021.07.06 SNAP INC
  • US11057601B2 patent drawing
  • US11057601B2 patent drawing
  • US11057601B2 patent drawing

AI summary

In a method for superimposing a prerecorded media file into a video, a video of a scene is displayed on a display device of a mobile electronic device. A prerecorded video file to render on the display device is received. The prerecorded video file is superimposed over the video, such that the video is partially obscured by the prerecorded video file. The prerecorded video is played file while displaying the video, such that the prerecorded video file and a non-obscured portion of the video are rendered simultaneously.