Active Display Time-Sliced Multiplexing for Camera Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for capturing images with LED displays in video production face challenges such as moiré effects, flickering, and the need to accurately identify camera position and orientation, which affect immersion and post-production efficiency.

Innovation Solution

A method involving a digital camera synchronized with active displays showing image data at a high display frame rate, using time-sliced multiplexing to present additional chromakey and tracking pattern data without interfering with the main image content, and reducing flickering by presenting secondary data at a lower frame rate or using complementary images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If chromakey image data and tracking pattern data are presented on LED displays during video recording, then post-production flexibility and camera tracking precision are improved, but moiré effects and flickering occur that degrade image quality

Engineering Contradiction:
Improvecamera tracking precisionVSAvoidmoiré effects
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The display frame is segmented into multiple time slices, with different regions displaying different types of data (chromakey, tracking patterns, venue feed) at different times. This temporal segmentation allows the camera to capture tracking data without continuous moiré interference from pixel patterns.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Tracking patterns and chromakey data are presented periodically at specific frame rates that synchronize with the camera's exposure timing. By controlling the periodicity and timing of pattern presentation, the system achieves precise tracking while minimizing moiré effects through synchronized capture moments.

Inventive Principle:
Principle #19Periodic action

2Adaptability or versatility

If additional image data (chromakey, tracking patterns) is presented on LED displays, then post-production flexibility is improved, but viewer disturbance increases due to flickering

Engineering Contradiction:
Improvepost-production flexibilityVSAvoidflickering
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

Multiple sets of image data are presented in periodic time-sliced sequences, with each set displayed for a controlled duration. This periodic presentation ensures that no single data type causes sustained flickering, as the display alternates through different content types in a rhythmic pattern that can be synchronized with refresh rates.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The frame rate and timing parameters of different image data sets are adjusted and synchronized. By controlling the display duration and refresh timing of chromakey and tracking patterns relative to the main venue feed, the system maintains post-production flexibility while minimizing perceptible flickering through parameter optimization.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If high display frame rate is used for presenting multiple image data sets, then image quality and tracking precision are improved, but device complexity and data processing requirements increase

Engineering Contradiction:
Improvetracking precisionVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The high frame rate data stream is segmented into distinct time slices for different data types. This segmentation allows the system to process and transmit different image data sets (tracking patterns, chromakey, venue feed) separately at optimized intervals, reducing overall processing complexity while maintaining high effective frame rates for tracking precision.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12262138B2Method and system for capturing images
Publication Date: 2025.03.25 H2VR HOLDCO INC
  • US12262138B2 patent drawing
  • US12262138B2 patent drawing
  • US12262138B2 patent drawing

AI summary

The present disclosure concerns a method for producing images or a video of a scenery. The method includes the steps of providing a digital camera configured to capture images of said scenery, and arranging one or more active displays within or adjacent to said scenery, said one or more active displays being configured to show image data at a high display frame rate (HDFR). The method further includes the steps of presenting at least a first set of image data and a second set of image data on said active display in a time-sliced multiplexed manner, wherein at least said second set of image data comprises chromakey image data and/or tracking pattern image data, and capturing images of said scenery with said digital camera, with said capturing of images of said digital camera being synchronized with the presentation of image data on said active display.