Temporal Keying in Camera Video Frames for Venue Advertising

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current high frame rate cameras used in live events suffer from lower sensitivity and fail to properly display different advertisement streams to both venue and home audiences, as different advertisement streams are averaged in the viewer's eye, preventing proper advertisement display at the venue.

Innovation Solution

A system and method that captures a key-signal of a short time-cycle from electronic displays within video frames, using a camera configured to synchronize with higher frame rate displays, and a key signal processor to convert and identify key frames, allowing for separate processing and insertion of alternative content based on identified key signals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If high frame rate cameras are used to capture multiple advertisement streams, then the frame rate capability is improved, but the sensitivity deteriorates

Engineering Contradiction:
Improveframe rateVSAvoidsensitivity
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent segments the high frame rate video stream into individual frames and identifies specific key frames containing key signals. By processing frames individually and selectively extracting key signal information from特定 frames rather than continuously processing all frames, the system maintains high frame rate capability while reducing the sensitivity penalty associated with continuous high-speed capture.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If multiple advertisement streams are displayed on electronic displays, then the content variety is improved, but the advertisement display quality deteriorates due to averaging in the viewer's eye

Engineering Contradiction:
Improvecontent varietyVSAvoidadvertisement display quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent implements periodic display of different advertisement streams by inserting key frames at specific intervals within the high frame rate sequence. Each key frame contains a key signal that triggers the display of a specific advertisement stream. This periodic structure allows multiple advertisements to be displayed over time without causing temporal averaging, as each advertisement appears in discrete, separated time windows.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The key signal is embedded in advance within specific key frames of the video sequence before display. This preliminary embedding of the key signal allows the system to pre-configure which advertisement stream should be displayed when that particular frame is shown, ensuring that the correct advertisement is ready and waiting to be displayed without temporal overlap or averaging.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If key signal processing is added to separate and identify key frames, then the advertisement display precision is improved, but the device complexity increases

Engineering Contradiction:
Improveadvertisement display precisionVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical or hardware-based key signal detection systems with software-based processing of the video frame sequence. The key signal is embedded in the video data itself, allowing standard video processing equipment to extract and act on the key signal through algorithmic analysis of frame content, rather than requiring specialized hardware detectors.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11849244B2System and method for temporal keying in a camera
Publication Date: 2023.12.19 GRASS VALLEY CANADA
  • US11849244B2 patent drawing
  • US11849244B2 patent drawing
  • US11849244B2 patent drawing

AI summary

A system is provided for capturing a key signal within video frames that includes a camera that captures a sequence of media content of a live scene that includes an electronic display having a higher frame rate than an output frame rate of the camera, and a key signal processor that convert all frames in the sequence of media content to the output frame rate of the camera, analyzes a sequence of frames to determine the key signal based on the electronic display outputting a sequence of frames including media content and at least one key frame included in the sequence, and combine remaining frames of the sequence of frames to create a live output signal. Moreover, the key signal processor determines, for each pixel in the frames, whether the pixel has a set chromaticity, and generates a key mask for each pixel in each frame.