3D Video Production Software for Real-Time Live Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video production systems find it difficult to create three-dimensional images that appear to project vertically above or in front of a display screen, especially when adding 3D effects to live video feeds, which often results in significant lag delays during digital editing.

Innovation Solution

A system utilizing two stereoscopic cameras positioned proximate to a physical scene, with adjustable camera boom assemblies and 3D video production software that integrates left and right camera footage to create a superimposed video file, allowing real-time digital manipulation of live video streams to make subjects appear above or in front of the display screen with minimal processing delay.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional post-production methods are used to add 3D effects to video footage, then the quality of 3D effects can be achieved, but significant time delay occurs making it unsuitable for live video feeds

Engineering Contradiction:
Improve3D effect qualityVSAvoidprocessing delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary calibration of the stereoscopic camera pair before live recording, pre-configuring the geometric relationship between cameras and establishing the reference plane. This pre-setup enables real-time processing during live feeds without requiring time-consuming adjustments during the actual broadcast

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the 3D effect parameters in real-time based on the live video feed content. The software continuously processes incoming video frames, automatically maintaining proper stereoscopic alignment and 3D effects without manual intervention, adapting to moving subjects and changing scenes

Inventive Principle:
Principle #15Dynamics

2Shape

If stereoscopic cameras are positioned and oriented to create 3D images above or in front of the display screen, then the desired 3D projection effect is achieved, but complex adjustments to camera positions and orientation angles are required

Engineering Contradiction:
Improve3D projection effectVSAvoidcamera positioning complexity
Core Design Contradiction:
ShapeVSDevice complexity

Solution Approach 1:

The system introduces a reference plane as an intermediary construct that simplifies the complex spatial relationship between stereoscopic cameras and the display screen. By defining this virtual reference plane, the system automatically calculates and adjusts camera positions and orientations, transforming a complex manual alignment task into a standardized setup procedure

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes the approach from manually adjusting camera positions to modifying digital parameters in post-processing. The physical camera setup remains relatively simple, but software algorithms dynamically adjust image geometry, perspective, and stereoscopic parameters to achieve the desired 3D projection effect above or in front of the screen

Inventive Principle:
Principle #35Parameter changes

3Productivity

If real-time processing is implemented to add 3D effects to live video feeds, then processing delay is minimized, but the complexity of the digital manipulation system increases

Engineering Contradiction:
Improvereal-time processing capabilityVSAvoiddigital manipulation system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The real-time processing system is segmented into distinct functional modules: stereoscopic image separation, reference plane detection, 3D effect application, and output rendering. Each module handles a specific task independently, enabling parallel processing that reduces overall computation time while maintaining manageable system complexity through modular design

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10230939B2System, method and software for producing live video containing three-dimensional images that appear to project forward of or vertically above a display
Publication Date: 2019.03.12 MAXX MEDIA GROUP LLC
  • US10230939B2 patent drawing
  • US10230939B2 patent drawing
  • US10230939B2 patent drawing

AI summary

A system, method and software for producing 3D effects in a video of a physical scene. The 3D effects can be observed when the video is viewed, either during a live stream or later when viewing the recorded video. A reference plane is defined. The reference plane has peripheral boundaries. A live event is viewed with stereoscopic video cameras. The stereoscopic camera viewpoints are calculated that enable the event to be recorded within the peripheral boundaries of the reference plane. The footage from the stereoscopic video cameras is digitally altered prior to being imaged. The altering of the footage includes bending, tapering, stretching and/or tilting a portion of the footage in real time. Once the footage is altered, a common set of boundaries are set for superimposed footage to create a final video production.